2024-06-04 10:47:53.040 INFO 77632 --- [pool-10-thread-11,79cb4e2bd18a40c3,80872520a292] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2024-06-04 10:47:53.041 INFO 77632 --- [ForkJoinPool-6-worker-11,79cb4e2bd18a40c3,65e4e09c90cb] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select outline_name as outlineName,outline_id, outline_content, database_id, database_name, visible_signature, sql_text, concurrent_num, limit_target, create_time as gmt_create, modify_time from DBA_OB_CONCURRENT_LIMIT_SQL 2024-06-04 10:47:53.045 INFO 77632 --- [ForkJoinPool-6-worker-11,79cb4e2bd18a40c3,65e4e09c90cb] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:47:53.045 INFO 77632 --- [ForkJoinPool-6-worker-11,79cb4e2bd18a40c3,65e4e09c90cb] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:47:53.046 INFO 77632 --- [ForkJoinPool-6-worker-11,79cb4e2bd18a40c3,65e4e09c90cb] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select database_id, tenant_id, outline_id, outline_name as outlineName, outline_content, sql_text, sql_id, outline_target, create_time as gmt_create, modify_time from DBA_OB_OUTLINES 2024-06-04 10:47:53.085 INFO 77632 --- [pool-ocp-schedules-8,16ebd222c3554532,719ab9c3f41d] c.o.o.m.service.SeriesIdCleanService : HostIpSize=3, clusterSize=1, obproxyClusterSize=0 2024-06-04 10:47:53.099 INFO 77632 --- [pool-10-thread-12,79cb4e2bd18a40c3,16b5303cd6d1] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2024-06-04 10:47:53.325 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-06-04 10:47:53.351 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-06-04 10:47:53.357 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 3 2024-06-04 10:47:53.372 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-06-04 10:47:53.372 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435603667038208 2024-06-04 10:47:53.373 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-06-04 10:47:53.373 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435041944875008 2024-06-04 10:47:53.373 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-06-04 10:47:53.373 INFO 77632 --- [pool-ocp-schedules-1,7ca1038141884b8a,bbfa4a28ecb5] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435043945558016 2024-06-04 10:47:53.411 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-06-04 10:47:53.414 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 2 2024-06-04 10:47:53.478 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-06-04 10:47:53.483 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-06-04 10:47:53.567 INFO 77632 --- [pool-ocp-schedules-13,6aca9e7bdb3a4207,2ac45f2da9f9] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-06-04 10:47:53.567 INFO 77632 --- [pool-ocp-schedules-19,6238376729894ecb,3c6271fc0dc1] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=3, cachedSize=3 2024-06-04 10:47:53.777 INFO 77632 --- [pool-ocp-schedules-7,b51059cedcbc4ba1,9e9ca0bb6eaa] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:47:53.794 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:47:55.011 INFO 77632 --- [pool-ocp-async-8,288debced7be4415,e3e9c59faa5e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:47:55.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,31ed474aa89e4d6e,8823a3bca167] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469280, interval=60 2024-06-04 10:47:55.913 INFO 77632 --- [pool-prometheus-minute-schedule-1,31ed474aa89e4d6e,8823a3bca167] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:47:56.795 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:47:57.012 INFO 77632 --- [pool-ocp-async-7,d8881339d98349e5,39b762f6ca6a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:47:58.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,6d39137e81784f04,a9b9ad43c740] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469280, interval=60 2024-06-04 10:47:58.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,6d39137e81784f04,a9b9ad43c740] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:47:59.011 INFO 77632 --- [pool-ocp-async-5,8706021ac3a04e6d,52ff6664065e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:47:59.796 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:00.007 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2024-06-04 10:48:00.007 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-06-04 10:48:00.010 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-06-04 10:48:00.010 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : init spring 2024-06-04 10:48:00.010 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-06-04 10:48:00.010 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : starting 2024-06-04 10:48:00.013 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-06-04 10:48:00.013 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : init spring 2024-06-04 10:48:00.013 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-06-04 10:48:00.014 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : starting 2024-06-04 10:48:00.049 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-06-04 10:48:00.058 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-06-04 10:48:00.058 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-06-04 10:48:00.058 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-06-04 10:48:00.058 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.2.2 2024-06-04 10:48:00.058 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.2.2 2024-06-04 10:48:00.062 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-06-04 10:48:00.222 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:46:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.226 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999975, name=OasSqlCuring, templateName=OasSqlCuringSchedule, scheduleRule=0 */2 * * * *, lastRunTime=2024-06-04 10:46:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.361 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : Split list is empty, name=OasSqlCuringSchedule, splitKey=cluster_ids, context=Argument{parallelIdx=-1, stringMap={}, listMap={cluster_ids=[]}} 2024-06-04 10:48:00.376 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Subtask is empty, mark task failed, name=OasSqlCuringSchedule, taskId=119 2024-06-04 10:48:00.394 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-06-04 10:48:00.422 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.422 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999981, name=Collect all tenants major compactions, templateName=CollectTenantCompactionSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2024-06-04 10:47:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.456 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Collect all tenants major compactions, nodeCount=1, taskCount=1 2024-06-04 10:48:00.456 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:00.456 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Collect all tenants major compactions', taskDefinitionId=999981, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:00.456+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Collect all tenants major compactions, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.tenant.CollectAllTenantCompactionTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:00.512 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.512 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999982, name=Collect SlowSql to SqlAggregateData for alarm, templateName=CollectSlowSqlSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2024-06-04 10:47:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.542 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Collect SlowSql to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2024-06-04 10:48:00.542 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:00.542 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Collect SlowSql to SqlAggregateData for alarm', taskDefinitionId=999982, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:00.542+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Collect SlowSql to SqlAggregateData for alarm, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.sql.internal.alarm.CollectSlowSqlTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:00.641 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.642 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999983, name=Collect trans stat to SqlAggregateData for alarm, templateName=CollectTransSatatSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2024-06-04 10:47:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:48:00.710 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Collect trans stat to SqlAggregateData for alarm, nodeCount=1, taskCount=1 2024-06-04 10:48:00.710 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:00.710 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Collect trans stat to SqlAggregateData for alarm', taskDefinitionId=999983, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:00.710+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Collect trans stat to SqlAggregateData for alarm, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.perf.transaction.internal.alarm.CollectTransStatTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:00.711 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:48:00.778 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.764381803S 2024-06-04 10:48:00.778 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-06-04 10:48:00.789 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.789 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999984, name=Get agent alarms, templateName=GetAgentAlarmsSchedule, scheduleRule=0 */1 * * * *, lastRunTime=2024-06-04 10:47:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.833 INFO 77632 --- [pool-ocp-schedules-6,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-06-04 10:48:00.844 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Get agent alarms, nodeCount=1, taskCount=1 2024-06-04 10:48:00.844 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:00.844 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Get agent alarms', taskDefinitionId=999984, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:00.844+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Get all agent alarms, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.host.GetAgentAlarmsTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:00.846 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 175, operation:EXECUTE, state: RUNNING 2024-06-04 10:48:00.895 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:46:01.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:00 CST 2024 2024-06-04 10:48:00.895 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999992, name=Sync root service list, templateName=SyncRsListSchedule, scheduleRule=0 */2 * * * ?, lastRunTime=2024-06-04 10:46:01.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:00.916 INFO 77632 --- [pool-ocp-schedules-6,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-06-04 10:48:01.080 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-06-04 10:48:01.080 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-06-04 10:48:01.080 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-06-04 10:48:01.080 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.2.2 2024-06-04 10:48:01.080 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.2.2 2024-06-04 10:48:01.081 INFO 77632 --- [pool-ocp-schedules-6,,] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-06-04 10:48:01.102 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-06-04 10:48:01.111 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:00.0, nextRun=2024-06-04 10:48:00.0, currentDate=Tue Jun 04 10:48:01 CST 2024 2024-06-04 10:48:01.155 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=1000000, name=Detect alarms on schedule, templateName=BackupScheduleAlarmTemplateFactory, scheduleRule=0 */1 * * * *, lastRunTime=2024-06-04 10:47:00.0, nextRunTime=2024-06-04 10:48:00.0} 2024-06-04 10:48:01.187 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Detect alarms, nodeCount=1, taskCount=1 2024-06-04 10:48:01.187 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:01.187 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Detect alarms', taskDefinitionId=1000000, state=RUNNING, type=SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:01.187+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Detect alarms of backup, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.backup.internal.task.AlarmTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:01.241 INFO 77632 --- [pool-ocp-schedules-6,,] o.s.boot.SpringApplication : Started application in 1.231 seconds (JVM running for 724.152) 2024-06-04 10:48:01.242 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.231906383S 2024-06-04 10:48:01.378 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.s.c.c.w.MetadbDataSourceWrapper : [metadb] driver class=com.oceanbase.jdbc.Driver 2024-06-04 10:48:01.378 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.s.c.c.w.MetadbDataSourceWrapper : [metadb] username=root@ocp_meta 2024-06-04 10:48:01.378 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.s.c.c.w.MetadbDataSourceWrapper : [metadb] jdbc url=jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull 2024-06-04 10:48:01.378 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.o.b.spring.DataSourceInterceptor : dataSource metaDataSource already initialized. skipped. class: com.oceanbase.ocp.server.common.config.wrapper.MetadbDataSourceWrapper 2024-06-04 10:48:01.392 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:Ren_Test, tenant:sys 2024-06-04 10:48:01.415 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:Ren_Test, tenant:ocp_monitor 2024-06-04 10:48:01.454 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:Ren_Test, tenant:ocp_meta 2024-06-04 10:48:01.564 INFO 77632 --- [pool-ocp-schedules-6,,] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-06-04 10:48:01.614 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.619 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.619 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:48:01.620 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1] 2024-06-04 10:48:01.635 INFO 77632 --- [pool-Collect all tenants major compactions1,29707cefc4cf49ec,d864d97f429e] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2024-06-04 10:48:01.661 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.663 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.663 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:48:01.664 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004] 2024-06-04 10:48:01.670 INFO 77632 --- [pool-Collect all tenants major compactions2,29707cefc4cf49ec,e400d2339065] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2024-06-04 10:48:01.672 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.673 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.253, sql port:2881 2024-06-04 10:48:01.673 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:48:01.677 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002] 2024-06-04 10:48:01.684 INFO 77632 --- [pool-Collect all tenants major compactions3,29707cefc4cf49ec,08581420cbc0] o.i.t.TenantCompactionCollectServiceImpl : Cluster never major compaction, just skip 2024-06-04 10:48:01.687 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,30880660641e] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-06-04 10:48:01.729 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,30880660641e] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 175, operation:EXECUTE, state: SUCCESSFUL 2024-06-04 10:48:01.893 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 178, operation:EXECUTE, state: RUNNING 2024-06-04 10:48:01.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,4c16eee0c03c4ddd,81bfcca90465] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:01.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,4c16eee0c03c4ddd,81bfcca90465] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:01.953 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,d823438fd59e] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=178, context=Context{parallelIdx=-1, stringMap={task_instance_id=123, task_operation=execute, latest_execution_start_time=2024-06-04T10:48:01.889+08:00, sub_task_instance_name=Get all agent alarms, sub_task_instance_id=178}, listMap={}}, executor=192.168.5.253 2024-06-04 10:48:01.970 INFO 77632 --- [ForkJoinPool-13-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-06-04 10:48:01.971 INFO 77632 --- [ForkJoinPool-13-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-06-04 10:48:01.971 INFO 77632 --- [ForkJoinPool-13-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-06-04 10:48:01.987 INFO 77632 --- [ForkJoinPool-13-worker-1,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-06-04 10:48:01.992 INFO 77632 --- [ForkJoinPool-13-worker-1,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 2 2024-06-04 10:48:01.993 INFO 77632 --- [ForkJoinPool-13-worker-3,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-06-04 10:48:01.994 INFO 77632 --- [ForkJoinPool-13-worker-2,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-06-04 10:48:01.998 INFO 77632 --- [ForkJoinPool-13-worker-3,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 3 2024-06-04 10:48:02.000 INFO 77632 --- [ForkJoinPool-13-worker-2,,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1 2024-06-04 10:48:02.009 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,d823438fd59e] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 178, operation:EXECUTE, state: SUCCESSFUL 2024-06-04 10:48:02.096 INFO 77632 --- [ForkJoinPool-13-worker-2,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.5.253:62889/api/v1/log/alarms, params:null 2024-06-04 10:48:02.103 INFO 77632 --- [ForkJoinPool-13-worker-3,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.5.254:62889/api/v1/log/alarms, params:null 2024-06-04 10:48:02.103 INFO 77632 --- [ForkJoinPool-13-worker-1,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://192.168.5.252:62889/api/v1/log/alarms, params:null 2024-06-04 10:48:02.694 INFO 77632 --- [pool-ocp-async-10,27996286eaa8426d,81194324bc78] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:02.727 WARN 77632 --- [pool-scanner-12047-1,27996286eaa8426d,43716191a531] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:02.798 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:02.858 INFO 77632 --- [pool-ocp-async-4,3bb799e1f70c4a4f,6f0c6e82f3a3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:03.012 INFO 77632 --- [pool-ocp-async-2,e25dde482a1846fb,430d690930bc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:03.783 INFO 77632 --- [pool-ocp-schedules-9,6e6fbf81ce924178,9684606d6bbc] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:04.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,b21cd894415c4b2a,01f6a3106edd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:04.909 INFO 77632 --- [pool-prometheus-minute-schedule-1,b21cd894415c4b2a,01f6a3106edd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:05.012 INFO 77632 --- [pool-ocp-async-10,ca1557cd7c364221,6a3b33f1bec1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:05.799 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:07.012 INFO 77632 --- [pool-ocp-async-5,411451387b4549c4,96dbc8691031] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:07.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,a3f3a0c8725c4757,624cc07aeeda] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:07.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,a3f3a0c8725c4757,624cc07aeeda] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:08.800 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:09.012 INFO 77632 --- [pool-ocp-async-7,ebe3f2a742fc4d3a,182b2b0e3204] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:10.037 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.252, sql port:2883 2024-06-04 10:48:10.038 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.252, sql port:2883 2024-06-04 10:48:10.038 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:48:10.039 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-06-04 10:48:10.041 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk]:connected server ip:192.168.5.252, sql port:2883 2024-06-04 10:48:10.041 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-06-04 10:48:10.042 INFO 77632 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-06-04 10:48:10.042 INFO 77632 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Follower checked 2024-06-04 10:48:10.279 INFO 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 2, ruleSize = 2. 2024-06-04 10:48:10.307 WARN 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : no ready nodes for cache. startTime = 1717469160 2024-06-04 10:48:10.307 INFO 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-06-04 10:48:10.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,901d5f822ae64a2d,e0e0d8caeac3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:10.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,901d5f822ae64a2d,e0e0d8caeac3] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:10.956 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 181, operation:EXECUTE, state: RUNNING 2024-06-04 10:48:10.998 INFO 77632 --- [pool-subtask-executor32,b467a98d1ac94104,5442beed6593] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=181, context=Context{parallelIdx=-1, stringMap={task_instance_id=126, task_operation=execute, latest_execution_start_time=2024-06-04T10:48:10.953+08:00, sub_task_instance_name=Check obproxy connection status, sub_task_instance_id=181}, listMap={}}, executor=192.168.5.253 2024-06-04 10:48:11.011 INFO 77632 --- [pool-subtask-executor32,b467a98d1ac94104,5442beed6593] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 181, operation:EXECUTE, state: SUCCESSFUL 2024-06-04 10:48:11.012 INFO 77632 --- [pool-ocp-async-9,576b774378244116,15d133b05895] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:11.043 WARN 77632 --- [pool-scanner-12049-1,f48e1d8d1a404c01,1cd593d84d50] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load5, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685462589440, 654434999791681536, 654434999359524864] 2024-06-04 10:48:11.044 WARN 77632 --- [pool-scanner-12052-1,d57c392996dd44de,f3c93453bd94] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_MemTotal_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685584224256, 654434999959453696, 654434999451799552] 2024-06-04 10:48:11.044 WARN 77632 --- [pool-scanner-12051-1,144a1b4817a44e89,156d1b8dc6e1] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load1, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685299011584, 654434999749738496, 654434999300804608] 2024-06-04 10:48:11.044 WARN 77632 --- [pool-scanner-12050-1,f89c4fa8bf49470f,ff7a77f91ab5] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load15, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685328371712, 654434999774904320, 654434999334359041] 2024-06-04 10:48:11.045 WARN 77632 --- [pool-scanner-12055-1,42968874477e4cc8,d49dfbb4a8d8] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_MemFree_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685554864128, 654434999921704960, 654434999430828033] 2024-06-04 10:48:11.045 WARN 77632 --- [pool-scanner-12056-1,ef8e09eb38d14a4f,8c2cfe0887e4] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_Cached_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685533892608, 654434999867179008, 654434999418245120] 2024-06-04 10:48:11.045 WARN 77632 --- [pool-scanner-12054-1,88c0ada69926422e,17ea3f4abff6] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_Buffers_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685512921089, 654434999825235968, 654434999380496384] 2024-06-04 10:48:11.045 WARN 77632 --- [pool-scanner-12058-1,15cd3bd75ec84c24,1be1abd8898b] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_Cached_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685533892608, 654434999867179008, 654434999418245120] 2024-06-04 10:48:11.045 WARN 77632 --- [pool-scanner-12053-1,6a956011c45240bf,f63342b7e379] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_MemFree_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685554864128, 654434999921704960, 654434999430828033] 2024-06-04 10:48:11.046 WARN 77632 --- [pool-scanner-12059-1,d06629fc5019475d,0b09f8796643] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_Buffers_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685512921089, 654434999825235968, 654434999380496384] 2024-06-04 10:48:11.046 WARN 77632 --- [pool-scanner-12062-1,49843b4850614e5f,e9f6a0c77af5] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_memory_SReclaimable_bytes, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685601001473, 654434999997202432, 654434999485353984] 2024-06-04 10:48:11.047 WARN 77632 --- [pool-scanner-12061-1,3641ed43b3f34e41,155e201d3c30] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_read_time_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998495641600, 654434998147371008, 654434998445309952, 654434998126399488, 654434998386589696, 654434998105427968, 654434684023943169, 654434683956834306, 654434683998777345, 654434683919085570, 654434998340452352, 654434998071873536] 2024-06-04 10:48:11.047 WARN 77632 --- [pool-scanner-12063-1,e1665ebbd9ca468d,535bd4058ab1] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_reads_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998646636544, 654434998294171648, 654434998613082112, 654434998277394432, 654434998596304896, 654434998231257088, 654434684116217857, 654434684074274817, 654434684091052034, 654434684049108992, 654434998558556160, 654434998189314048] 2024-06-04 10:48:11.048 WARN 77632 --- [pool-scanner-12060-1,e24e0e82e69f4843,c6021f8ef888] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_writes_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998843768832, 654434998529052672, 654434998822797312, 654434998508081152, 654434998793437184, 654434998461943808, 654434684367876096, 654434684242046976, 654434684267212800, 654434684216881153, 654434998772465664, 654434998436777984] 2024-06-04 10:48:11.048 WARN 77632 --- [pool-scanner-12057-1,0ca88fe33e5c4b89,b0b4633e4433] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_reads_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998646636544, 654434998294171648, 654434998613082112, 654434998277394432, 654434998596304896, 654434998231257088, 654434684116217857, 654434684074274817, 654434684091052034, 654434684049108992, 654434998558556160, 654434998189314048] 2024-06-04 10:48:11.049 WARN 77632 --- [pool-scanner-12066-1,69961876c0dc49c6,0cb8ddfcb4a5] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_written_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998936043520, 654434998612938753, 654434998910877696, 654434998600355840, 654434998894100480, 654434998570995712, 654434684447567873, 654434684414013441, 654434684430790657, 654434684393041921, 654434998868934656, 654434998545829888] 2024-06-04 10:48:11.049 WARN 77632 --- [pool-scanner-12065-1,ff19d14fed8a4433,df2ea6658b21] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_read_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998306897920, 654434998025736192, 654434998285926400, 654434998000570368, 654434998256566272, 654434997967015936, 654434683898114048, 654434683843588099, 654434683872948225, 654434683822616577, 654434998214623232, 654434997912489984] 2024-06-04 10:48:11.050 WARN 77632 --- [pool-scanner-12069-1,4dda85bf497546ee,c9197a0ad315] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_writes_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998843768832, 654434998529052672, 654434998822797312, 654434998508081152, 654434998793437184, 654434998461943808, 654434684367876096, 654434684242046976, 654434684267212800, 654434684216881153, 654434998772465664, 654434998436777984] 2024-06-04 10:48:11.051 WARN 77632 --- [pool-scanner-12064-1,095bc692a6f244a3,85f4ba132722] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_write_time_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998755688448, 654434998420000768, 654434998717939712, 654434998382252032, 654434998688579584, 654434998352891904, 654434684191715328, 654434684158160897, 654434684174938114, 654434684132995072, 654434998663413760, 654434998315143168] 2024-06-04 10:48:11.056 WARN 77632 --- [pool-scanner-12067-1,a4182ceb7d6e4f1e,f4e40357b74b] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_network_receive_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685617778688, 654435000022368256, 654434999523102720, 654435000081088512, 654434999577628672, 654435000118837248, 654434999606988800, 654434685676498945, 654434685697470465] 2024-06-04 10:48:11.056 WARN 77632 --- [pool-scanner-12068-1,b63a64f0c5f44e68,7d87a2a14676] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_network_transmit_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434685961711616, 654435000433410048, 654434999942533120, 654435000500518912, 654435000013836288, 654435000529879040, 654435000043196416, 654434686062374912, 654434686095929344] 2024-06-04 10:48:11.059 WARN 77632 --- [pool-scanner-12072-1,d0fe98e3fa194848,b046ff24b118] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load15, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434999774904320] 2024-06-04 10:48:11.059 WARN 77632 --- [pool-scanner-12074-1,99cb87e0639542e1,203d68206b69] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_cpu_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434997463842816, 654434997589671936, 654434997614837760, 654434997539340288, 654434997572894720, 654434997279293440] 2024-06-04 10:48:11.059 WARN 77632 --- [pool-scanner-12075-1,4ffce3c48857449d,a3205b12f7fb] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_cpu_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434997589671936] 2024-06-04 10:48:11.060 WARN 77632 --- [pool-scanner-12071-1,7bf8eb61849e40db,c3cb48c0e955] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load5, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434999791681536] 2024-06-04 10:48:11.060 WARN 77632 --- [pool-scanner-12077-1,0a8de8d7d88e4849,da3205239898] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_cpu_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434997614837760] 2024-06-04 10:48:11.060 WARN 77632 --- [pool-scanner-12078-1,a93b6a14e65449f9,377a73bf7eda] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric cpu_count, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435001066749952] 2024-06-04 10:48:11.061 WARN 77632 --- [pool-scanner-12079-1,c3364e9837e64d60,816a1fd4160b] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_cpu_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434997375762432] 2024-06-04 10:48:11.061 WARN 77632 --- [pool-scanner-12080-1,8779003c1d8445a0,05a4bdb9e6a5] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric cpu_count, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435001066749952] 2024-06-04 10:48:11.062 WARN 77632 --- [pool-scanner-12081-1,1c9172bafa2d44a8,eaa6c1bdfe70] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric io_util, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435001591037952, 654435001691701248, 654435001674924032, 654435001658146816, 654435001620398080, 654435001507151872, 654435001553289216] 2024-06-04 10:48:11.063 WARN 77632 --- [pool-scanner-12082-1,dc4a20e19b6b4f4a,d7cc2eda80b0] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_io_time_weighted_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998176874496, 654434998130737152, 654434998084599808, 654434998063628288] 2024-06-04 10:48:11.058 WARN 77632 --- [pool-scanner-12073-1,6e11f5d010504a91,ba92bd0498de] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_cpu_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434997279293440] 2024-06-04 10:48:11.058 WARN 77632 --- [pool-scanner-12070-1,04c1499c2c384ec1,ed72dede7e5f] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_load1, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434999749738496] 2024-06-04 10:48:11.063 WARN 77632 --- [pool-scanner-12083-1,c45fe15a6a774f84,7c0159340e7d] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_reads_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998646636544, 654434998613082112, 654434998596304896, 654434998558556160] 2024-06-04 10:48:11.064 WARN 77632 --- [pool-scanner-12076-1,7c9e7b090f8f4a5a,31ece3fe63a2] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric cpu_count, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435001066749952] 2024-06-04 10:48:11.064 WARN 77632 --- [pool-scanner-12085-1,a756730aecf94681,534e46aee663] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_read_time_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998495641600, 654434998445309952, 654434998386589696, 654434998340452352] 2024-06-04 10:48:11.064 WARN 77632 --- [pool-scanner-12086-1,5e2bd94bea6b430f,170fd274a18f] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_reads_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998646636544, 654434998613082112, 654434998596304896, 654434998558556160] 2024-06-04 10:48:11.065 WARN 77632 --- [pool-scanner-12084-1,677eb88d42b74b04,7a89fd48df83] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_writes_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998843768832, 654434998822797312, 654434998793437184, 654434998772465664] 2024-06-04 10:48:11.065 WARN 77632 --- [pool-scanner-12088-1,e2ec3313bdb54a13,2ca131897587] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_read_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998306897920, 654434998285926400, 654434998256566272, 654434998214623232] 2024-06-04 10:48:11.066 WARN 77632 --- [pool-scanner-12090-1,79aeb7c86e0748ab,774aa5eb0ee7] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_network_receive_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435000022368256, 654435000081088512, 654435000118837248] 2024-06-04 10:48:11.066 WARN 77632 --- [pool-scanner-12091-1,48f377fd4f834f47,75efa2ab28c5] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_network_transmit_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654435000433410048, 654435000500518912, 654435000529879040] 2024-06-04 10:48:11.066 WARN 77632 --- [pool-scanner-12087-1,a5b2db4e6ce841d1,9049edd4db29] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_write_time_seconds_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998755688448, 654434998717939712, 654434998688579584, 654434998663413760] 2024-06-04 10:48:11.066 WARN 77632 --- [pool-scanner-12092-1,e3467f64f43341a4,de41603d0178] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_writes_completed_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998843768832, 654434998822797312, 654434998793437184, 654434998772465664] 2024-06-04 10:48:11.067 WARN 77632 --- [pool-scanner-12089-1,fcde425dbe21458d,c3d75e8451c9] c.o.o.m.s.OcpPrometheusScanBusinessImpl : No available async series data for metric node_disk_written_bytes_total, startTime = 1717469205, endTime = 1717469275, seriesIds = [654434998936043520, 654434998910877696, 654434998894100480, 654434998868934656] 2024-06-04 10:48:11.802 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:12.694 INFO 77632 --- [pool-ocp-async-6,2a4b8fde3b77445e,0da8c9726138] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:12.733 WARN 77632 --- [pool-scanner-12101-1,2a4b8fde3b77445e,0d9477e0b3f2] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:12.859 INFO 77632 --- [pool-ocp-async-9,1ac33e0de0464aa4,f55e44e6acbb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:13.012 INFO 77632 --- [pool-ocp-async-4,c229632f7b4f47b9,f8bf836ac21f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:13.571 INFO 77632 --- [pool-ocp-schedules-10,e9481c869d3646d7,7b41917dc8be] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-06-04 10:48:13.787 INFO 77632 --- [pool-ocp-schedules-19,bdb0a99116914093,7d6318a121a6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:13.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,14f826d902574468,055d4e16b954] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:13.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,14f826d902574468,055d4e16b954] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:14.808 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:15.013 INFO 77632 --- [pool-ocp-async-7,6a014a93fa0048dd,678bbb0ad34f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:15.128 INFO 77632 --- [pool-metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1717469220, nodeCount=436, affectRows=436 2024-06-04 10:48:15.129 INFO 77632 --- [pool-metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1717469220, nodeCount=435, validCount=435 2024-06-04 10:48:16.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,de49f7101cf940a3,595cee04f17f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:16.911 INFO 77632 --- [pool-prometheus-minute-schedule-1,de49f7101cf940a3,595cee04f17f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:17.013 INFO 77632 --- [pool-ocp-async-2,976a6857f16a4e41,8720b8444811] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:17.809 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:19.013 INFO 77632 --- [pool-ocp-async-5,1dc6c8fc84354fb3,e2c41a766c82] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:19.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,5cf055d11ccc4811,6e1ddf6ac791] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:19.915 INFO 77632 --- [pool-prometheus-minute-schedule-1,5cf055d11ccc4811,6e1ddf6ac791] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:20.169 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:47:20.0, nextRun=2024-06-04 10:48:20.0, currentDate=Tue Jun 04 10:48:20 CST 2024 2024-06-04 10:48:20.169 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999996, name=Collect all cluster compaction info, templateName=CollectClusterCompactionSchedule, scheduleRule=20 * * * * *, lastRunTime=2024-06-04 10:47:20.0, nextRunTime=2024-06-04 10:48:20.0} 2024-06-04 10:48:20.174 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Collect all cluster compaction info, nodeCount=1, taskCount=1 2024-06-04 10:48:20.175 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:20.175 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Collect all cluster compaction info', taskDefinitionId=999996, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:20.175+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Collect compaction for all clusters, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.CollectAllClustersCompactionTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:20.810 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:21.013 INFO 77632 --- [pool-ocp-async-8,771872f1571a4aee,d6a3be2d3779] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:22.694 INFO 77632 --- [pool-ocp-async-6,2f652c17d6554755,f717c24ffcdc] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:22.736 WARN 77632 --- [pool-scanner-12141-1,2f652c17d6554755,681d59fd2bbe] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:22.860 INFO 77632 --- [pool-ocp-async-8,4faeb85802e241c2,626965c461cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:22.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,c4149a56783f422e,d199fbdacc5a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:22.909 INFO 77632 --- [pool-prometheus-hour-schedule-1,c1aed00dcdc74a35,fac996b90b75] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717470000, interval=3600 2024-06-04 10:48:22.915 INFO 77632 --- [pool-prometheus-minute-schedule-1,c4149a56783f422e,d199fbdacc5a] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:23.013 INFO 77632 --- [pool-ocp-async-10,a52828951b4d4387,b22949914518] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:23.793 INFO 77632 --- [pool-ocp-schedules-2,3e83b654b5e84ca0,21ff953cf2b9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:23.812 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:25.016 INFO 77632 --- [pool-ocp-async-3,00e260c8ffe142b1,b8a6d52837d7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:25.906 INFO 77632 --- [pool-prometheus-minute-schedule-1,37282ff965a745be,e44c447a80b8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:25.912 INFO 77632 --- [pool-prometheus-minute-schedule-1,37282ff965a745be,e44c447a80b8] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:26.820 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:27.013 INFO 77632 --- [pool-ocp-async-8,dbbe3a7db34146b9,ee603833e65b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:28.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,143a302d2f8444ba,948685a8d55c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:28.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,143a302d2f8444ba,948685a8d55c] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:29.014 INFO 77632 --- [pool-ocp-async-9,5e29537a674a4278,cabbc0ed6a57] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:29.821 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:30.671 INFO 77632 --- [pool-print-time-series-interval15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469310: {1717469220=57, 1717469235=57, 1717469250=57, 1717469265=57, 1717469280=57, 1717469295=57, 1717469310=8}, tsDataMapSize: 50504, readyDataCacheSize: 8288 2024-06-04 10:48:30.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:48:30.710 INFO 77632 --- [pool-print-time-series-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469310: {}, tsDataMapSize: 80, readyDataCacheSize: 64 2024-06-04 10:48:31.014 INFO 77632 --- [pool-ocp-async-5,64f000e56a1b4b37,d1319142da70] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:31.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,d9546d917faa4953,4437984c9b7f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:31.909 INFO 77632 --- [pool-prometheus-minute-schedule-1,d9546d917faa4953,4437984c9b7f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:32.694 INFO 77632 --- [pool-ocp-async-9,2cebbe7335f74679,39d53d9a1db6] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:32.744 WARN 77632 --- [pool-scanner-12172-1,2cebbe7335f74679,0a80569394ee] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:32.824 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:32.859 INFO 77632 --- [pool-ocp-async-10,359374f862b34079,2febe1c26219] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:33.021 INFO 77632 --- [pool-ocp-async-7,cf8cdf8f06b94ae3,02e530ec3922] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:33.578 INFO 77632 --- [pool-ocp-schedules-8,c68a961853344f48,9afec13d864d] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-06-04 10:48:33.797 INFO 77632 --- [pool-ocp-schedules-5,6ed2bc5fdc324239,f8cc35d6bc1a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:34.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,df8f59829ccd4fc9,63b357c4d7b0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:34.909 INFO 77632 --- [pool-prometheus-minute-schedule-1,df8f59829ccd4fc9,63b357c4d7b0] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:35.014 INFO 77632 --- [pool-ocp-async-6,f85e8c5e000b486b,2cad27a533c1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:35.825 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:37.014 INFO 77632 --- [pool-ocp-async-10,222e3a9c504b47ce,ab573a3d6815] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:37.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,b0bbdc82661a4d69,eaa752c85e79] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:37.912 INFO 77632 --- [pool-prometheus-minute-schedule-1,b0bbdc82661a4d69,eaa752c85e79] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:38.826 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:39.014 INFO 77632 --- [pool-ocp-async-4,4ea7d7e3c3a74d18,7080b8d8baf1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:40.268 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-06-04 10:48:10.0, nextRun=2024-06-04 10:48:40.0, currentDate=Tue Jun 04 10:48:40 CST 2024 2024-06-04 10:48:40.268 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999997, name=Check obproxy, templateName=CheckObproxyServerSchedule, scheduleRule=10/30 * * * * *, lastRunTime=2024-06-04 10:48:10.0, nextRunTime=2024-06-04 10:48:40.0} 2024-06-04 10:48:40.281 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Check obproxy, nodeCount=1, taskCount=1 2024-06-04 10:48:40.281 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.m.r.t.m.SubtaskInstanceEntity : Set state for subtask: null, current state: PENDING, new state: READY 2024-06-04 10:48:40.281 INFO 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Check obproxy', taskDefinitionId=999997, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='192.168.5.253', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-06-04T10:48:40.281+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Check obproxy connection status, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.obproxy.CheckObproxyTask, seriesId=0, startTime=null, endTime=null}], template=null, traceId='29707cefc4cf49ec', operation=EXECUTE} 2024-06-04 10:48:40.908 INFO 77632 --- [pool-prometheus-minute-schedule-1,915f98d25be54f1e,89434206cf85] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:40.918 INFO 77632 --- [pool-prometheus-minute-schedule-1,915f98d25be54f1e,89434206cf85] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:41.014 INFO 77632 --- [pool-ocp-async-5,3898b78293d24587,86dffe6055d7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:41.095 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 184, operation:EXECUTE, state: RUNNING 2024-06-04 10:48:41.155 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,24ecc8c1326c] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=184, context=Context{parallelIdx=-1, stringMap={task_instance_id=129, task_operation=execute, latest_execution_start_time=2024-06-04T10:48:41.092+08:00, sub_task_instance_name=Check obproxy connection status, sub_task_instance_id=184}, listMap={}}, executor=192.168.5.253 2024-06-04 10:48:41.175 INFO 77632 --- [pool-subtask-executor32,29707cefc4cf49ec,24ecc8c1326c] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 184, operation:EXECUTE, state: SUCCESSFUL 2024-06-04 10:48:41.191 INFO 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:129, status:SUCCESS 2024-06-04 10:48:41.193 INFO 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:129, status:SUCCESS 2024-06-04 10:48:41.214 INFO 77632 --- [pool-12-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Not the leader for service:PLAN_CHANGE_DETECTOR, skipped 2024-06-04 10:48:41.324 INFO 77632 --- [pool-14-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Not the leader for service:SQL_PERF_DIAGNOSER, skipped 2024-06-04 10:48:41.365 INFO 77632 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Not the leader for service:SQL_INDEX_DIAGNOSER, skipped 2024-06-04 10:48:41.828 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:41.909 INFO 77632 --- [pool-prometheus-cache-monitor1,be9e1acb12584f56,5d257e1144bc] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1744,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":436,"seriesIdKeySize":4854,"secondWriteQueue":0,"minuteWriteCacheSize":955} 2024-06-04 10:48:41.910 INFO 77632 --- [pool-prometheus-cache-monitor1,be9e1acb12584f56,5d257e1144bc] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, node_memory_sreclaimable_bytes=12, ob_sysstat_40011=17, ob_server_resource_memory_assigned_bytes=10, ob_sysstat_40010=17, tcp_retrans=13, ob_unit_num=10, ob_database_disk_required_size=31, go_memstats_mspan_sys_bytes=10, ob_sysstat_30213=17, go_memstats_stack_sys_bytes=10, ob_sysstat_30212=17, exporter_export_metrics_bytes_total=20, ob_sysstat_30217=17, node_filesystem_size_bytes=35, ob_sysstat_30216=17, http_server_requests_seconds_count=60, ob_tenant_request_queue_total_size=20, jvm_gc_memory_allocated_bytes_total=5, ob_system_event_total_waits=21, monagent_input_sql_duration_seconds_sum=55, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=15, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=5, node_filesystem_readonly=35, go_memstats_frees_total=10, io_await=31, host_available=7, ob_sysstat_30220=17, ob_sysstat_30222=17, ob_sysstat_30221=17, go_memstats_mallocs_total=10, ob_unit_config_max_memory_bytes=19, ob_database_disk_data_size=30, io_util=31, ob_sysstat_200002=17, ob_tenant_memstore_freeze_cnt=14, ob_sysstat_200001=17, ob_tenant_disk_v4_data_size=12, ob_tenant_unit_min_memory=26, ob_sysstat_60087=17, ob_memstore_total_bytes=20, metric_cardinality_count=12, jvm_threads_states_threads=10, process_resident_memory_bytes=10, ob_cache_size_bytes=28, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=26, input_collect_metrics_total=15, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=20, node_disk_write_time_seconds_total=20, cpu_count=13, ob_cluster_sync=6, process_open_fds=10, ob_sysstat_50037=17, process_memory_rss_bytes=17, http_status_count=13, process_max_fds=10, ob_server_resource_cpu_assigned_percent=10, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=122, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=10, go_memstats_mcache_sys_bytes=10, ob_sysstat_40118=17, ob_sysstat_40117=17, ob_tenant_disk_v4_log_size=12, node_memory_memfree_bytes=12, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=26, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=15, ob_sysstat_40001=17, ob_server_resource_disk_bytes=10, ocp_alarm_detect_duration_ms_sum=122, ob_sysstat_40000=17, jvm_threads_live_threads=5, ob_sysstat_30200=17, ob_sysstat_30201=17, ob_sysstat_30204=17, ob_sysstat_30205=17, ob_sysstat_30208=17, process_thread_count=17, ob_sysstat_30209=17, node_memory_cached_bytes=12, ob_sysstat_50040=17, ob_table_num=16, ob_sysstat_40009=17, ob_sysstat_40008=17, ob_disk_free_bytes=10, node_filesystem_avail_bytes=35, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=19, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=16, go_memstats_last_gc_time_seconds=10, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=10, ocp_monitor_collect_request_duration_ms_count=9, monagent_oceanbase_plan_explain_size=3, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=31, node_disk_read_bytes_total=20, clock_diff_milliseconds=6, ob_compaction_is_suspended=12, go_memstats_lookups_total=10, process_cpu_percent=17, log_tailer_count=10, ob_sysstat_60057=17, host_agent_process_status=10, ob_server_resource_cpu=10, go_memstats_alloc_bytes=10, ob_server_num=14, node_cpu_seconds_total_native=18, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_session_all_num=16, ob_tenant_resource_min_memory=16, jvm_gc_pause_seconds_count=9, ob_memstore_freeze_times=20, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=5, ob_system_event_time_waited=21, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=24, jvm_memory_committed_bytes=12, node_net_bandwidth_bps=16, monagent_oceanbase_db_pool_idle=3, ob_tenant_server_data_index_data_size=15, go_memstats_heap_idle_bytes=10, go_memstats_gc_sys_bytes=10, ob_server_resource_memory_bytes=10, go_info=11, ob_tenant_assigned_mem_assigned=16, log_tailer_processed_file_count=10, node_load15=12, ob_tenant_memstore_minor_freeze_times=14, ob_disk_log_assigned_bytes=10, ob_tenant_server_required_size=15, jvm_memory_max_bytes=12, ob_unit_config_min_iops=19, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=17, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_sysstat_30084=17, ob_tenant_unit_max_cpu=26, ob_sysstat_30083=17, node_memory_buffers_bytes=12, ob_sysstat_30086=17, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=10, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=16, ob_sysstat_50005=17, ob_sysstat_50008=17, ob_memstore_freeze_trigger_bytes=20, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=11, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=10, ob_session_active_num=16, node_filesystem_files_free=43, ob_memtable_max_snapshot_duration_seconds=10, node_disk_read_time_seconds_total=20, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=3, ob_sysstat_60024=17, ob_compaction_frozen_version=12, ob_sysstat_60023=17, metric_count=10, ob_sysstat_60022=17, process_virtual_memory_bytes=10, observer_coredump_time_seconds=10, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=26, ob_unit_config_max_cpu=19, http_request_milliseconds_summary_count=27, monagent_oceanbase_audit_timeinfo_cache_size=3, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=59, ob_sysstat_20001=17, node_cpu_seconds_total=20, ob_sysstat_20000=17, http_request_milliseconds_summary=30, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=12, go_memstats_buck_hash_sys_bytes=10, monagent_pipeline_report_metrics_total=10, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=20, exporter_export_metrics_total=20, ob_disk_log_total_bytes=10, ob_sysstat_60019=17, system_cpu_count=5, process_uptime_seconds=17, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=10, ocp_meta_db_health=6, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=9, ob_disk_total_bytes=10, watch_ob_dir_exists=15, ob_tenant_request_queue_large_size=20, go_memstats_heap_objects=10, go_memstats_mcache_inuse_bytes=10, go_memstats_other_sys_bytes=10, ob_sysstat_130000=17, jvm_memory_used_bytes=12, ob_sysstat_130001=17, go_threads=10, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=27, http_server_requests_seconds_sum=60, ob_memstore_active_bytes=20, go_memstats_alloc_bytes_total=10, ob_tenant_assigned_mem_total=16, process_count=18, node_memory_memtotal_bytes=12, node_network_transmit_drop_total=16, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=5, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=10, ob_tenant500_memory_used_bytes=10, node_network_transmit_bytes_total=16, ob_compaction_is_error=12, node_network_receive_drop_total=16, monagent_pipeline_execute_total=16, node_filesystem_files=43, process_start_time_seconds=10, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=10, ob_tenant_resource_max_cpu=16, go_gc_duration_seconds_sum=10, go_memstats_mspan_inuse_bytes=10, ob_server_resource_memory_assigned_percent=10, monagent_pipeline_execute_seconds_total=16, jvm_gc_pause_seconds_sum=9, ob_sysstat_80001=17, go_memstats_sys_bytes=10, node_network_receive_errs_total=16, system_load_average_1m=5, monagent_oceanbase_audit_stat_cache_size=3, observer_ulimit_max_fd_count=10, ob_plan_cache_access_total=16, ob_tenant_memory_used_bytes=16, monagent_oceanbase_plan_cache_size=3, monagent_oceanbase_audit_sample_cache_size=3, ob_tenant_server_data_size=15, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=20, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=10, node_load1=12, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=5, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=10, ob_sysstat_120008=17, node_load5=12, ob_sysstat_120005=17, jvm_threads_peak_threads=5, ob_sysstat_120006=17, process_cpu_usage=5, monagent_input_sql_duration_seconds_count=55, node_disk_written_bytes_total=20, monagent_oceanbase_ash_cache_size=3, monagent_pipeline_process_metrics_total=20, go_goroutines=10, ob_compaction_last_version=12, ob_sysstat_30000=17, ob_sysstat_30002=17, ob_server_resource_cpu_assigned=10, ob_sysstat_30001=17, ob_unit_config_min_cpu=19, process_virtual_memory_max_bytes=10, monagent_oceanbase_plan_timeinfo_cache_size=3, monagent_plugin_execute_total=24, ob_sysstat_30006=17, ob_tenant500_memory_hold_bytes=10, ob_sysstat_30005=17, arbitration_status_inactive_server_count=6, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=12, ob_clog_max_sync_delay_seconds=13, oceanbase_connectivity=12} 2024-06-04 10:48:42.694 INFO 77632 --- [pool-ocp-async-4,b98ba99c463d4421,cd21847390d1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:42.718 WARN 77632 --- [pool-scanner-12199-1,b98ba99c463d4421,da384d35eb67] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:42.859 INFO 77632 --- [pool-ocp-async-5,641459507fc74b3b,b16bf4d1f475] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:43.015 INFO 77632 --- [pool-ocp-async-6,25b0240cf2d54f2d,bf2d8564c92c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:43.801 INFO 77632 --- [pool-ocp-schedules-14,f8fdf9b05abf4f4e,4df6268ced86] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:43.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,a8ad20e6af5e42c3,a0b38c3f507f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:43.910 INFO 77632 --- [pool-prometheus-minute-schedule-1,a8ad20e6af5e42c3,a0b38c3f507f] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=2, collectTaskCount=2 2024-06-04 10:48:44.832 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :192.168.5.252:8080 2024-06-04 10:48:45.015 INFO 77632 --- [pool-ocp-async-7,961c5720d3cc44fa,8328189a1f28] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:45.102 INFO 77632 --- [pool-prometheus-second-schedule-1,8d6833ce987048c4,23de6e10244d] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=1, collectTaskCount=1 2024-06-04 10:48:45.480 ERROR 77632 --- [sshj-Reader-/192.168.5.252:22,,] n.schmizz.sshj.transport.TransportImpl : Dying because - Broken transport; encountered EOF net.schmizz.sshj.transport.TransportException: Broken transport; encountered EOF at net.schmizz.sshj.transport.Reader.run(Reader.java:58) 2024-06-04 10:48:45.480 INFO 77632 --- [sshj-Reader-/192.168.5.252:22,,] n.schmizz.sshj.transport.TransportImpl : Disconnected - UNKNOWN 2024-06-04 10:48:45.723 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356876322) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.724 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:45.724 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843574) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.sharding.ShardingCoordinator.sharding(ShardingCoordinator.java:81) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.725 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:48:45.880 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLNonTransientConnectionException: (conn=356876329) Connection is closed at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:230) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.cmdPrologue(AbstractQueryProtocol.java:2447) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:298) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:312) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.doCleanupAfterCompletion(JpaTransactionManager.java:650) at org.springframework.transaction.support.AbstractPlatformTransactionManager.cleanupAfterCompletion(AbstractPlatformTransactionManager.java:992) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:790) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:711) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:654) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:407) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.saveAndFlush(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.refreshConsumer(ConsumerRegistry.java:145) at java.util.Optional.map(Optional.java:215) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:87) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.881 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to 192.168.5.252:2883 : Could not connect to 192.168.5.252:2883 : Connection reset at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:235) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1644) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to 192.168.5.252:2883 : Connection reset at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:210) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.FilterInputStream.read(FilterInputStream.java:133) at com.oceanbase.jdbc.internal.io.input.ReadAheadBufferedStream.fillBuffer(ReadAheadBufferedStream.java:148) at com.oceanbase.jdbc.internal.io.input.ReadAheadBufferedStream.read(ReadAheadBufferedStream.java:121) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:156) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.com.read.ReadInitialHandShakePacket.(ReadInitialHandShakePacket.java:88) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:557) ... 7 common frames omitted 2024-06-04 10:48:45.884 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLNonTransientConnectionException: (conn=356778042) Connection is closed at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:230) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.cmdPrologue(AbstractQueryProtocol.java:2447) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:298) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:312) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.doCleanupAfterCompletion(JpaTransactionManager.java:650) at org.springframework.transaction.support.AbstractPlatformTransactionManager.cleanupAfterCompletion(AbstractPlatformTransactionManager.java:992) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:790) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:711) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:654) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:407) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.saveAndFlush(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.refreshConsumer(ConsumerRegistry.java:145) at java.util.Optional.map(Optional.java:215) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:87) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.888 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to commit against JDBC Connection; nested exception is org.hibernate.TransactionException: Unable to commit against JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:566) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:743) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:711) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:654) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:407) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.saveAndFlush(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.refreshConsumer(ConsumerRegistry.java:145) at java.util.Optional.map(Optional.java:215) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:87) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.TransactionException: Unable to commit against JDBC Connection at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.commit(AbstractLogicalConnectionImplementor.java:92) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.commit(JdbcResourceLocalTransactionCoordinatorImpl.java:282) at org.hibernate.engine.transaction.internal.TransactionImpl.commit(TransactionImpl.java:101) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:562) ... 24 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356778042) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.OceanBaseStatement.executeInternal(OceanBaseStatement.java:488) at com.oceanbase.jdbc.OceanBaseStatement.execute(OceanBaseStatement.java:631) at com.oceanbase.jdbc.OceanBaseConnection.commit(OceanBaseConnection.java:884) at com.alibaba.druid.pool.DruidPooledConnection.commit(DruidPooledConnection.java:782) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.commit(AbstractLogicalConnectionImplementor.java:86) ... 27 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.OceanBaseStatement.executeInternal(OceanBaseStatement.java:482) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 32 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 34 common frames omitted 2024-06-04 10:48:45.890 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. Connection refused (Connection refused) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:45.890 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to commit against JDBC Connection; nested exception is org.hibernate.TransactionException: Unable to commit against JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:566) at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:743) at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:711) at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:654) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:407) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.saveAndFlush(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.refreshConsumer(ConsumerRegistry.java:145) at java.util.Optional.map(Optional.java:215) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:87) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.TransactionException: Unable to commit against JDBC Connection at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.commit(AbstractLogicalConnectionImplementor.java:92) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.commit(JdbcResourceLocalTransactionCoordinatorImpl.java:282) at org.hibernate.engine.transaction.internal.TransactionImpl.commit(TransactionImpl.java:101) at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:562) ... 24 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356876329) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.OceanBaseStatement.executeInternal(OceanBaseStatement.java:488) at com.oceanbase.jdbc.OceanBaseStatement.execute(OceanBaseStatement.java:631) at com.oceanbase.jdbc.OceanBaseConnection.commit(OceanBaseConnection.java:884) at com.alibaba.druid.pool.DruidPooledConnection.commit(DruidPooledConnection.java:782) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.commit(AbstractLogicalConnectionImplementor.java:86) ... 27 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.OceanBaseStatement.executeInternal(OceanBaseStatement.java:482) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 32 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 34 common frames omitted 2024-06-04 10:48:45.890 INFO 77632 --- [Druid-ConnectionPool-Create-2037087596,,] c.a.druid.pool.DruidAbstractDataSource : {dataSource-2} failContinuous is true 2024-06-04 10:48:45.895 ERROR 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778019) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.handleExecutingSubtask(ExecutingSubtaskWorker.java:74) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.work(ExecutingSubtaskWorker.java:67) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.896 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:48:45.987 ERROR 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843589) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.FailedSubtaskWorker.work(FailedSubtaskWorker.java:51) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:45.987 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:48:46.135 ERROR 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811141) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllIdByState() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:44) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ReadySubtaskWorker.work(ReadySubtaskWorker.java:69) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.135 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:48:46.267 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843568) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.267 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:46.391 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. Connection refused (Connection refused) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:46.656 WARN 77632 --- [pool-ocp-schedules-13,adf355836bda4579,9d9319c8677d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: 08000 2024-06-04 10:48:46.657 ERROR 77632 --- [pool-ocp-schedules-13,adf355836bda4579,9d9319c8677d] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=356876305) unexpected end of stream, read 0 bytes from 4 2024-06-04 10:48:46.659 ERROR 77632 --- [pool-ocp-schedules-13,adf355836bda4579,9d9319c8677d] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356876305) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.ExtendedEntityManagerCreator$ExtendedEntityManagerInvocationHandler.invoke(ExtendedEntityManagerCreator.java:362) at com.sun.proxy.$Proxy294.close(Unknown Source) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:444) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.663 ERROR 77632 --- [pool-ocp-schedules-13,adf355836bda4579,9d9319c8677d] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.dao.DataAccessResourceFailureException: could not extract ResultSet; nested exception is org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:255) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:48) at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:37) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:67) at org.hibernate.loader.Loader.getResultSet(Loader.java:2322) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2075) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356876305) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:175) at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:57) ... 60 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ... 64 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ... 65 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 67 common frames omitted 2024-06-04 10:48:46.724 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811142) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.725 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:46.866 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: 08000 2024-06-04 10:48:46.867 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=356778031) unexpected end of stream, read 0 bytes from 4 2024-06-04 10:48:46.867 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778031) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.ExtendedEntityManagerCreator$ExtendedEntityManagerInvocationHandler.invoke(ExtendedEntityManagerCreator.java:362) at com.sun.proxy.$Proxy294.close(Unknown Source) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:444) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.868 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.dao.DataAccessResourceFailureException: could not extract ResultSet; nested exception is org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:255) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:48) at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:37) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:67) at org.hibernate.loader.Loader.getResultSet(Loader.java:2322) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2075) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356778031) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:175) at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:57) ... 53 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ... 57 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ... 58 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 60 common frames omitted 2024-06-04 10:48:46.892 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. Connection refused (Connection refused) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:46.896 ERROR 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843550) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.handleExecutingSubtask(ExecutingSubtaskWorker.java:74) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.work(ExecutingSubtaskWorker.java:67) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.897 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:48:46.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,5f156ef85eae43e5,e4977e5160e2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:46.906 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5f156ef85eae43e5,e4977e5160e2] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811146) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.909 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5f156ef85eae43e5,e4977e5160e2] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356811146) Connection is closed at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:230) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.cmdPrologue(AbstractQueryProtocol.java:2447) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:298) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 33 common frames omitted 2024-06-04 10:48:46.918 ERROR 77632 --- [pool-prometheus-exporter-check2,f2168f72d3344f8b,148182d36ef0] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778006) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.920 ERROR 77632 --- [pool-prometheus-exporter-check2,f2168f72d3344f8b,148182d36ef0] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 30 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 32 common frames omitted 2024-06-04 10:48:46.988 ERROR 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843552) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.FailedSubtaskWorker.work(FailedSubtaskWorker.java:51) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:46.988 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:48:47.016 INFO 77632 --- [pool-ocp-async-2,7619375113fa432a,a4c28dd3e8ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:47.017 ERROR 77632 --- [pool-ocp-async-5,916cb9d1b8114caa,cb1f18130f2c] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778032) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.lockAndExec(AlarmNotifier.java:101) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doNotifyTask(AlarmNotifier.java:137) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$ca38577b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.017 ERROR 77632 --- [pool-ocp-async-2,7619375113fa432a,a4c28dd3e8ef] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811034) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.service.common.DistributedLockAspect.aroundMethod(DistributedLockAspect.java:61) at sun.reflect.GeneratedMethodAccessor339.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.017 ERROR 77632 --- [pool-ocp-async-7,871a7c0da76b428d,7ccbe05d3eb2] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811275) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.lockAndExec(AlarmNotifier.java:101) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.fetchNotificationInMemoryTask(AlarmNotifier.java:116) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$ca38577b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.136 ERROR 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356810933) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllIdByState() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:44) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ReadySubtaskWorker.work(ReadySubtaskWorker.java:69) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.136 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:48:47.268 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843551) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.268 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:47.726 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778005) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.726 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:47.835 ERROR 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356876304) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.springframework.jdbc.datasource.DataSourceUtils.doCloseConnection(DataSourceUtils.java:407) at org.springframework.jdbc.datasource.DataSourceUtils.doReleaseConnection(DataSourceUtils.java:394) at org.springframework.jdbc.datasource.DataSourceUtils.releaseConnection(DataSourceUtils.java:361) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:673) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.836 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.dao.DataAccessResourceFailureException: PreparedStatementCallback; SQL [SELECT SERVER_ID FROM DISTRIBUTED_SERVICE WHERE NAME = ?]; (conn=356876304) unexpected end of stream, read 0 bytes from 4; nested exception is java.sql.SQLNonTransientConnectionException: (conn=356876304) unexpected end of stream, read 0 bytes from 4 at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:81) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:70) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:79) at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1583) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:675) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: (conn=356876304) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:175) at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) at org.springframework.jdbc.core.JdbcTemplate$1.doInPreparedStatement(JdbcTemplate.java:730) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:656) ... 16 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ... 21 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ... 22 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 24 common frames omitted 2024-06-04 10:48:47.836 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:48:47.843 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: 08000 2024-06-04 10:48:47.843 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=356843565) unexpected end of stream, read 0 bytes from 4 2024-06-04 10:48:47.843 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843565) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.ExtendedEntityManagerCreator$ExtendedEntityManagerInvocationHandler.invoke(ExtendedEntityManagerCreator.java:362) at com.sun.proxy.$Proxy294.close(Unknown Source) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:444) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.844 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.dao.DataAccessResourceFailureException: could not extract ResultSet; nested exception is org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:255) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:48) at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:37) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:67) at org.hibernate.loader.Loader.getResultSet(Loader.java:2322) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2075) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356843565) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:175) at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:57) ... 53 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ... 57 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ... 58 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 60 common frames omitted 2024-06-04 10:48:47.897 ERROR 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778030) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.handleExecutingSubtask(ExecutingSubtaskWorker.java:74) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ExecutingSubtaskWorker.work(ExecutingSubtaskWorker.java:67) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.897 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:48:47.988 ERROR 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356810932) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllByStateAndUpdateTimeGreaterThan() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:46) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.FailedSubtaskWorker.work(FailedSubtaskWorker.java:51) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:47.989 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:48:48.136 ERROR 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356843569) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskAccessor$$EnhancerBySpringCGLIB$$3aba0100.findAllIdByState() at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.AbstractSubtaskWorker.getSubtaskIds(AbstractSubtaskWorker.java:44) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ReadySubtaskWorker.work(ReadySubtaskWorker.java:69) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.execute(SubtaskCoordinator.java:75) at com.oceanbase.ocp.core.task.engine.coordinator.SubtaskCoordinator.lambda$null$0(SubtaskCoordinator.java:56) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:48.136 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:48:48.269 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356876321) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:48.270 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:48.727 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356876303) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.JpaTransactionManager.closeEntityManagerAfterFailedBegin(JpaTransactionManager.java:514) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:466) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:48.727 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.TransactionException: JDBC begin transaction failed: at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.TransactionException: JDBC begin transaction failed: at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:78) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:285) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:312) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:285) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.setAutoCommit(AbstractQueryProtocol.java:1806) at com.oceanbase.jdbc.OceanBaseConnection.setAutoCommit(OceanBaseConnection.java:871) at com.alibaba.druid.pool.DruidPooledConnection.setAutoCommit(DruidPooledConnection.java:740) at org.hibernate.resource.jdbc.internal.AbstractLogicalConnectionImplementor.begin(AbstractLogicalConnectionImplementor.java:72) ... 23 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:307) ... 28 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 30 common frames omitted 2024-06-04 10:48:48.888 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: 08000 2024-06-04 10:48:48.888 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : (conn=356811359) unexpected end of stream, read 0 bytes from 4 2024-06-04 10:48:48.889 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356811359) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.closeConnection(DatasourceConnectionProviderImpl.java:127) at org.hibernate.internal.NonContextualJdbcConnectionAccess.releaseConnection(NonContextualJdbcConnectionAccess.java:49) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.releaseConnection(LogicalConnectionManagedImpl.java:219) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.close(LogicalConnectionManagedImpl.java:261) at org.hibernate.engine.jdbc.internal.JdbcCoordinatorImpl.close(JdbcCoordinatorImpl.java:175) at org.hibernate.internal.AbstractSharedSessionContract.close(AbstractSharedSessionContract.java:374) at org.hibernate.internal.SessionImpl.closeWithoutOpenChecks(SessionImpl.java:413) at org.hibernate.internal.SessionImpl.close(SessionImpl.java:398) at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.ExtendedEntityManagerCreator$ExtendedEntityManagerInvocationHandler.invoke(ExtendedEntityManagerCreator.java:362) at com.sun.proxy.$Proxy294.close(Unknown Source) at org.springframework.orm.jpa.EntityManagerFactoryUtils.closeEntityManager(EntityManagerFactoryUtils.java:427) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:444) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:48.889 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.dao.DataAccessResourceFailureException: could not extract ResultSet; nested exception is org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:255) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.JDBCConnectionException: could not extract ResultSet at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:48) at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:37) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:67) at org.hibernate.loader.Loader.getResultSet(Loader.java:2322) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2075) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: (conn=356811359) unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeQuery(JDBC4PreparedStatement.java:175) at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeQuery(DruidPooledPreparedStatement.java:227) at org.hibernate.engine.jdbc.internal.ResultSetReturnImpl.extract(ResultSetReturnImpl.java:57) ... 53 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:199) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ... 57 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ... 58 common frames omitted Caused by: java.io.EOFException: unexpected end of stream, read 0 bytes from 4 at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.readMysqlStream(StandardPacketInputStream.java:158) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacketArray(StandardPacketInputStream.java:104) at com.oceanbase.jdbc.internal.io.input.StandardPacketInputStream.getPacket(StandardPacketInputStream.java:91) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ... 60 common frames omitted 2024-06-04 10:48:49.015 INFO 77632 --- [pool-ocp-async-9,49f8816ac2dd4dbf,e45d809a25a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:49.395 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:49.905 INFO 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:50.891 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:50.898 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:50.934 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:50.989 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.015 INFO 77632 --- [pool-ocp-async-7,3c14d28cb92a4927,86ea98b3bce3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:51.015 WARN 77632 --- [pool-ocp-async-3,f849887b7ace4ebb,f067194ce971] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.015 WARN 77632 --- [pool-ocp-async-1,297cd70c1d274f64,a7c3c46a880b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.016 WARN 77632 --- [pool-ocp-async-9,49f8816ac2dd4dbf,e45d809a25a2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.025 WARN 77632 --- [pool-ocp-async-7,3c14d28cb92a4927,86ea98b3bce3] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:48:51.137 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.269 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.270 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.312 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.734 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.869 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:51.900 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:51.910 WARN 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:52.694 INFO 77632 --- [pool-ocp-async-4,b13be0492d074b32,6248b75c207a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:48:52.728 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:52.836 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:52.841 WARN 77632 --- [pool-scanner-12223-1,b13be0492d074b32,aa462a6683fb] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:48:52.845 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:52.867 INFO 77632 --- [pool-ocp-async-8,7aa61af1fad04386,7aa81a4b8f5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:48:52.881 ERROR 77632 --- [pool-ocp-schedules-16,65a4a5290ade49c7,5f9fef44fb1a] com.alibaba.druid.pool.DruidDataSource : recyle error java.sql.SQLSyntaxErrorException: (conn=356778013) Connection.clearWarnings cannot be called on a closed connection at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:110) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:211) at com.oceanbase.jdbc.OceanBaseConnection.clearWarnings(OceanBaseConnection.java:1164) at com.alibaba.druid.pool.DruidConnectionHolder.reset(DruidConnectionHolder.java:331) at com.alibaba.druid.pool.DruidDataSource.recycle(DruidDataSource.java:1949) at com.alibaba.druid.pool.DruidPooledConnection.recycle(DruidPooledConnection.java:351) at com.alibaba.druid.pool.DruidPooledConnection.close(DruidPooledConnection.java:288) at org.springframework.jdbc.datasource.DataSourceUtils.doCloseConnection(DataSourceUtils.java:407) at org.springframework.jdbc.datasource.DataSourceUtils.doReleaseConnection(DataSourceUtils.java:394) at org.springframework.jdbc.datasource.DataSourceUtils.releaseConnection(DataSourceUtils.java:361) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:396) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:513) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:520) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDb(HealthCheckService.java:188) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDbHealth(HealthCheckService.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-06-04 10:48:52.891 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:52.891 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 490, createErrorCount 6 2024-06-04 10:48:52.892 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 490, createErrorCount 6 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:52.899 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:52.899 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 498, createErrorCount 6 2024-06-04 10:48:52.899 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:48:52.934 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 533, createErrorCount 6 2024-06-04 10:48:52.989 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:52.989 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 588, createErrorCount 6 2024-06-04 10:48:52.989 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:48:53.015 WARN 77632 --- [pool-ocp-async-3,f849887b7ace4ebb,f067194ce971] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.015 ERROR 77632 --- [pool-ocp-async-3,f849887b7ace4ebb,f067194ce971] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 614, createErrorCount 6 2024-06-04 10:48:53.016 WARN 77632 --- [pool-ocp-async-1,297cd70c1d274f64,a7c3c46a880b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.016 ERROR 77632 --- [pool-ocp-async-1,297cd70c1d274f64,a7c3c46a880b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 615, createErrorCount 6 2024-06-04 10:48:53.016 INFO 77632 --- [pool-ocp-async-1,572187b22da24542,9353e9fbfef7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:53.016 WARN 77632 --- [pool-ocp-async-10,01368c8ac70440e2,695c7bd47e3d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:53.017 WARN 77632 --- [pool-ocp-async-9,49f8816ac2dd4dbf,e45d809a25a2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.017 ERROR 77632 --- [pool-ocp-async-9,49f8816ac2dd4dbf,e45d809a25a2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 616, createErrorCount 6 2024-06-04 10:48:53.017 WARN 77632 --- [pool-ocp-async-6,0730cd264e514f69,537941ad99df] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:53.137 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.137 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 736, createErrorCount 6 2024-06-04 10:48:53.137 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:48:53.269 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.270 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 868, createErrorCount 6 2024-06-04 10:48:53.270 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:48:53.270 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.270 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 869, createErrorCount 6 2024-06-04 10:48:53.271 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 869, createErrorCount 6 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:53.312 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.312 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 911, createErrorCount 6 2024-06-04 10:48:53.312 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:48:53.374 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-06-04 10:48:53.374 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435603667038208 2024-06-04 10:48:53.734 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.734 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1333, createErrorCount 6 2024-06-04 10:48:53.735 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1333, createErrorCount 6 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:53.805 INFO 77632 --- [pool-ocp-schedules-2,deafbffea6134c03,1b40010ba28c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:48:53.873 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.873 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 1472, createErrorCount 6 2024-06-04 10:48:53.873 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 1472, createErrorCount 6 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:53.890 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:53.910 WARN 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:53.910 ERROR 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1509, createErrorCount 6 2024-06-04 10:48:53.911 ERROR 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1509, createErrorCount 6 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:53.911 INFO 77632 --- [pool-prometheus-minute-schedule-1,b103b3ae40c14cb7,842a37dff035] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469329905, count=0, elapsed=4006 2024-06-04 10:48:53.911 INFO 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:54.299 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.403 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:54.682 WARN 77632 --- [pool-ocp-schedules-6,578bddc5242b4880,67aaebb1a7eb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.687 WARN 77632 --- [pool-ocp-schedules-17,74cbcc84e70149e6,577881570322] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.687 WARN 77632 --- [pool-ocp-schedules-10,f83a4928b43c49fe,5c4ff045d62c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.689 WARN 77632 --- [pool-ocp-schedules-13,ced5341caf384fa5,92e1e2c19881] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.690 WARN 77632 --- [pool-ocp-schedules-8,517e42faa1d049c5,a6d7177e5f88] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.690 WARN 77632 --- [pool-ocp-schedules-11,7c233010d5c24c62,072a4d420c8e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.691 WARN 77632 --- [pool-ocp-schedules-9,61256acee7b04e75,85f477c4192e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.692 WARN 77632 --- [pool-ocp-schedules-20,634779c7cc30427a,b38b19dfae56] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.692 WARN 77632 --- [pool-ocp-schedules-7,ca014c62ef3a4cd8,0e3ab7c5c591] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.694 WARN 77632 --- [pool-ocp-async-2,0852e7201bbd4e98,4205dc28375c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.694 WARN 77632 --- [pool-ocp-async-5,2139bedb7c804615,476f7d551025] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.694 WARN 77632 --- [pool-ocp-async-7,3472d665666548a7,364f7bf3948f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.730 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:54.730 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 7 2024-06-04 10:48:54.730 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:48:54.837 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 7 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:54.837 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:48:54.841 WARN 77632 --- [pool-ocp-schedules-14,5b45bc1903054b91,fa36d4d4c1f5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.845 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:54.845 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 7 2024-06-04 10:48:54.845 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:54.859 WARN 77632 --- [pool-overview-container-6,7026085aff3842d3,c1f986b6e107] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.859 WARN 77632 --- [pool-overview-container-3,a3e26ed785034afc,cd4e9b71a019] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.867 WARN 77632 --- [pool-overview-container-2,c6d0febd6ba14561,166149d3b403] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.867 WARN 77632 --- [pool-overview-container-5,91fc532ca7e941d4,a4a05bf2f0b7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.870 WARN 77632 --- [pool-ocp-async-8,7aa61af1fad04386,7aa81a4b8f5d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.873 WARN 77632 --- [pool-overview-container-4,29e01e3ae38d4864,112fa788c564] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.883 WARN 77632 --- [pool-overview-container-1,62038334fcbf41a0,967c4aa4c04e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.885 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:54.889 WARN 77632 --- [pool-ocp-schedules-16,65a4a5290ade49c7,5f9fef44fb1a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:54.935 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.009 WARN 77632 --- [pool-ocp-schedules-12,73938f877602423d,3a85010efe77] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.015 WARN 77632 --- [pool-ocp-async-4,2bf80af8f76646c6,8f3c439bfa46] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.016 WARN 77632 --- [pool-ocp-async-3,ada126eec2c04081,564b88cd881b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.017 WARN 77632 --- [pool-ocp-async-10,01368c8ac70440e2,695c7bd47e3d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:55.017 ERROR 77632 --- [pool-ocp-async-10,01368c8ac70440e2,695c7bd47e3d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 112, createErrorCount 7 2024-06-04 10:48:55.017 WARN 77632 --- [pool-ocp-async-6,0730cd264e514f69,537941ad99df] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:55.017 WARN 77632 --- [pool-ocp-async-1,572187b22da24542,9353e9fbfef7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.017 ERROR 77632 --- [pool-ocp-async-6,0730cd264e514f69,537941ad99df] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 113, createErrorCount 7 2024-06-04 10:48:55.017 INFO 77632 --- [pool-ocp-async-6,d4b0b5b065cc4bd3,6f2c4000bc08] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:55.027 WARN 77632 --- [pool-ocp-async-6,d4b0b5b065cc4bd3,6f2c4000bc08] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:48:55.159 WARN 77632 --- [pool-ocp-schedules-19,ca679fa590a54e5e,b4f7c4674451] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.243 WARN 77632 --- [pool-ocp-schedules-1,52fdacee05094802,4bb32e6a67db] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.377 WARN 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.465 WARN 77632 --- [pool-ocp-schedules-18,861c274a08e54406,154a31dddd45] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.581 WARN 77632 --- [pool-ocp-schedules-15,6d3bf8653b6245a8,22cf080a17cc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.806 WARN 77632 --- [pool-ocp-schedules-2,deafbffea6134c03,1b40010ba28c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.896 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:55.896 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2005, active 0, maxActive 200, creating 1, createElapseMillis 991, createErrorCount 7 2024-06-04 10:48:55.896 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2005, active 0, maxActive 200, creating 1, createElapseMillis 991, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:55.899 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.911 WARN 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:55.990 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:56.141 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:56.271 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:56.300 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1395, createErrorCount 7 2024-06-04 10:48:56.682 WARN 77632 --- [pool-ocp-schedules-6,578bddc5242b4880,67aaebb1a7eb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.682 ERROR 77632 --- [pool-ocp-schedules-6,578bddc5242b4880,67aaebb1a7eb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1778, createErrorCount 7 2024-06-04 10:48:56.686 ERROR 77632 --- [pool-ocp-schedules-6,578bddc5242b4880,67aaebb1a7eb] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy298.findByKeyAndApplicationAndProfileAndLabel(Unknown Source) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:191) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:186) at com.oceanbase.ocp.service.audit.AuditEventService.enableAudit(AuditEventService.java:306) at com.oceanbase.ocp.service.audit.AuditEventService.refreshMethodToAuditEventMetaMap(AuditEventService.java:313) at com.oceanbase.ocp.service.audit.AuditEventService$$FastClassBySpringCGLIB$$cf41526c.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.audit.AuditEventService$$EnhancerBySpringCGLIB$$b5127495.refreshMethodToAuditEventMetaMap() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 31 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1778, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.688 WARN 77632 --- [pool-ocp-schedules-17,74cbcc84e70149e6,577881570322] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.688 ERROR 77632 --- [pool-ocp-schedules-17,74cbcc84e70149e6,577881570322] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 7 2024-06-04 10:48:56.688 WARN 77632 --- [pool-ocp-schedules-10,f83a4928b43c49fe,5c4ff045d62c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.688 ERROR 77632 --- [pool-ocp-schedules-10,f83a4928b43c49fe,5c4ff045d62c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 7 2024-06-04 10:48:56.688 ERROR 77632 --- [pool-ocp-schedules-10,f83a4928b43c49fe,5c4ff045d62c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.688 ERROR 77632 --- [pool-ocp-schedules-17,74cbcc84e70149e6,577881570322] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.689 WARN 77632 --- [pool-ocp-schedules-13,ced5341caf384fa5,92e1e2c19881] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.689 ERROR 77632 --- [pool-ocp-schedules-13,ced5341caf384fa5,92e1e2c19881] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1785, createErrorCount 7 2024-06-04 10:48:56.690 ERROR 77632 --- [pool-ocp-schedules-13,ced5341caf384fa5,92e1e2c19881] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1785, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.690 WARN 77632 --- [pool-ocp-schedules-8,517e42faa1d049c5,a6d7177e5f88] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.690 ERROR 77632 --- [pool-ocp-schedules-8,517e42faa1d049c5,a6d7177e5f88] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1786, createErrorCount 7 2024-06-04 10:48:56.691 ERROR 77632 --- [pool-ocp-schedules-8,517e42faa1d049c5,a6d7177e5f88] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1786, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.691 WARN 77632 --- [pool-ocp-schedules-11,7c233010d5c24c62,072a4d420c8e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.691 ERROR 77632 --- [pool-ocp-schedules-11,7c233010d5c24c62,072a4d420c8e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1786, createErrorCount 7 2024-06-04 10:48:56.691 ERROR 77632 --- [pool-ocp-schedules-11,7c233010d5c24c62,072a4d420c8e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1786, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.692 WARN 77632 --- [pool-ocp-schedules-7,ca014c62ef3a4cd8,0e3ab7c5c591] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.692 ERROR 77632 --- [pool-ocp-schedules-7,ca014c62ef3a4cd8,0e3ab7c5c591] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1787, createErrorCount 7 2024-06-04 10:48:56.692 ERROR 77632 --- [pool-ocp-schedules-7,ca014c62ef3a4cd8,0e3ab7c5c591] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1787, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.693 WARN 77632 --- [pool-ocp-schedules-9,61256acee7b04e75,85f477c4192e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.694 ERROR 77632 --- [pool-ocp-schedules-9,61256acee7b04e75,85f477c4192e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1789, createErrorCount 7 2024-06-04 10:48:56.694 ERROR 77632 --- [pool-ocp-schedules-9,61256acee7b04e75,85f477c4192e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1789, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.694 WARN 77632 --- [pool-ocp-async-5,2139bedb7c804615,476f7d551025] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.694 ERROR 77632 --- [pool-ocp-async-5,2139bedb7c804615,476f7d551025] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1790, createErrorCount 7 2024-06-04 10:48:56.694 WARN 77632 --- [pool-ocp-schedules-20,634779c7cc30427a,b38b19dfae56] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.694 ERROR 77632 --- [pool-ocp-schedules-20,634779c7cc30427a,b38b19dfae56] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1790, createErrorCount 7 2024-06-04 10:48:56.701 ERROR 77632 --- [pool-ocp-schedules-20,634779c7cc30427a,b38b19dfae56] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1790, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.704 WARN 77632 --- [pool-ocp-async-2,0852e7201bbd4e98,4205dc28375c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.704 WARN 77632 --- [pool-ocp-async-7,3472d665666548a7,364f7bf3948f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.704 ERROR 77632 --- [pool-ocp-async-2,0852e7201bbd4e98,4205dc28375c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1800, createErrorCount 7 2024-06-04 10:48:56.704 ERROR 77632 --- [pool-ocp-async-7,3472d665666548a7,364f7bf3948f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2010, active 0, maxActive 200, creating 1, createElapseMillis 1800, createErrorCount 7 2024-06-04 10:48:56.705 WARN 77632 --- [pool-ocp-async-5,2139bedb7c804615,476f7d551025] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy392.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmSubscriptionService.listAll(OcpAlarmSubscriptionService.java:406) at com.oceanbase.ocp.alarm.core.notification.AlarmStatisticsService.doScheduleTask(AlarmStatisticsService.java:129) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(AlarmNotifier.java:304) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$ca38577b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1790, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.735 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:56.860 WARN 77632 --- [pool-overview-container-6,7026085aff3842d3,c1f986b6e107] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.860 ERROR 77632 --- [pool-overview-container-6,7026085aff3842d3,c1f986b6e107] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 2024-06-04 10:48:56.860 WARN 77632 --- [pool-overview-container-3,a3e26ed785034afc,cd4e9b71a019] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.860 ERROR 77632 --- [pool-overview-container-3,a3e26ed785034afc,cd4e9b71a019] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 2024-06-04 10:48:56.862 ERROR 77632 --- [pool-overview-container-6,7026085aff3842d3,c1f986b6e107] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.865 ERROR 77632 --- [pool-overview-container-3,a3e26ed785034afc,cd4e9b71a019] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.865 WARN 77632 --- [pool-overview-container-6,7026085aff3842d3,c1f986b6e107] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.865 WARN 77632 --- [pool-overview-container-3,a3e26ed785034afc,cd4e9b71a019] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.867 WARN 77632 --- [pool-overview-container-2,c6d0febd6ba14561,166149d3b403] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.867 ERROR 77632 --- [pool-overview-container-2,c6d0febd6ba14561,166149d3b403] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1963, createErrorCount 7 2024-06-04 10:48:56.872 WARN 77632 --- [pool-ocp-async-8,7aa61af1fad04386,7aa81a4b8f5d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.872 ERROR 77632 --- [pool-ocp-async-8,7aa61af1fad04386,7aa81a4b8f5d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1967, createErrorCount 7 2024-06-04 10:48:56.872 ERROR 77632 --- [pool-overview-container-2,c6d0febd6ba14561,166149d3b403] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1963, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.872 WARN 77632 --- [pool-overview-container-2,c6d0febd6ba14561,166149d3b403] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1963, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.872 WARN 77632 --- [pool-overview-container-5,91fc532ca7e941d4,a4a05bf2f0b7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.872 ERROR 77632 --- [pool-overview-container-5,91fc532ca7e941d4,a4a05bf2f0b7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1965, createErrorCount 7 2024-06-04 10:48:56.873 WARN 77632 --- [pool-overview-container-4,29e01e3ae38d4864,112fa788c564] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.873 ERROR 77632 --- [pool-overview-container-4,29e01e3ae38d4864,112fa788c564] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1968, createErrorCount 7 2024-06-04 10:48:56.874 ERROR 77632 --- [pool-overview-container-5,91fc532ca7e941d4,a4a05bf2f0b7] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1965, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.875 WARN 77632 --- [pool-overview-container-5,91fc532ca7e941d4,a4a05bf2f0b7] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1965, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.875 ERROR 77632 --- [pool-overview-container-4,29e01e3ae38d4864,112fa788c564] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1968, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.875 WARN 77632 --- [pool-overview-container-4,29e01e3ae38d4864,112fa788c564] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1968, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.886 WARN 77632 --- [pool-overview-container-1,62038334fcbf41a0,967c4aa4c04e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:56.886 ERROR 77632 --- [pool-overview-container-1,62038334fcbf41a0,967c4aa4c04e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 7 2024-06-04 10:48:56.888 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.888 INFO 77632 --- [Druid-ConnectionPool-Create-1397998595,,] c.a.druid.pool.DruidAbstractDataSource : {dataSource-3} failContinuous is true 2024-06-04 10:48:56.888 ERROR 77632 --- [pool-overview-container-1,62038334fcbf41a0,967c4aa4c04e] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.889 WARN 77632 --- [pool-overview-container-1,62038334fcbf41a0,967c4aa4c04e] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 7 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.889 WARN 77632 --- [pool-ocp-schedules-16,65a4a5290ade49c7,5f9fef44fb1a] o.s.jdbc.support.SQLErrorCodesFactory : Error while extracting database name org.springframework.jdbc.support.MetaDataAccessException: Could not get Connection for extracting meta-data; nested exception is org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 2 at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:363) at org.springframework.jdbc.support.SQLErrorCodesFactory.resolveErrorCodes(SQLErrorCodesFactory.java:235) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.lambda$setDataSource$0(SQLErrorCodeSQLExceptionTranslator.java:140) at org.springframework.util.function.SingletonSupplier.get(SingletonSupplier.java:97) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.setDataSource(SQLErrorCodeSQLExceptionTranslator.java:141) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.(SQLErrorCodeSQLExceptionTranslator.java:102) at org.springframework.jdbc.support.JdbcAccessor.getExceptionTranslator(JdbcAccessor.java:136) at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1583) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:398) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:513) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:520) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDb(HealthCheckService.java:188) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDbHealth(HealthCheckService.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 2 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:337) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 2 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.914 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:56.935 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.010 WARN 77632 --- [pool-ocp-schedules-12,73938f877602423d,3a85010efe77] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.010 ERROR 77632 --- [pool-ocp-schedules-12,73938f877602423d,3a85010efe77] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.010 ERROR 77632 --- [pool-ocp-schedules-12,73938f877602423d,3a85010efe77] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.AlarmSummaryServiceImpl.refreshClusterAlarmSummary(AlarmSummaryServiceImpl.java:94) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmSummary(AlarmSchedules.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.015 WARN 77632 --- [pool-ocp-async-9,c93816cdaeae44d0,2d1fdadbea75] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:57.016 INFO 77632 --- [pool-ocp-async-8,f89ba7d4b4af49a9,111da0c8a125] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:57.016 WARN 77632 --- [pool-ocp-async-4,2bf80af8f76646c6,8f3c439bfa46] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.016 ERROR 77632 --- [pool-ocp-async-4,2bf80af8f76646c6,8f3c439bfa46] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.016 WARN 77632 --- [pool-ocp-async-3,ada126eec2c04081,564b88cd881b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.016 ERROR 77632 --- [pool-ocp-async-3,ada126eec2c04081,564b88cd881b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.017 WARN 77632 --- [pool-ocp-async-1,572187b22da24542,9353e9fbfef7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.017 ERROR 77632 --- [pool-ocp-async-1,572187b22da24542,9353e9fbfef7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.022 WARN 77632 --- [pool-ocp-async-10,9af8f4bdbf344e19,6e956e16bc74] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:57.025 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:57.159 WARN 77632 --- [pool-ocp-schedules-19,ca679fa590a54e5e,b4f7c4674451] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.159 ERROR 77632 --- [pool-ocp-schedules-19,ca679fa590a54e5e,b4f7c4674451] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.159 ERROR 77632 --- [pool-ocp-schedules-19,ca679fa590a54e5e,b4f7c4674451] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostVersionSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostVersionSchedule(ClusterSchedules.java:131) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 17 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.243 WARN 77632 --- [pool-ocp-schedules-1,52fdacee05094802,4bb32e6a67db] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.243 ERROR 77632 --- [pool-ocp-schedules-1,52fdacee05094802,4bb32e6a67db] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 2024-06-04 10:48:57.244 ERROR 77632 --- [pool-ocp-schedules-1,52fdacee05094802,4bb32e6a67db] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at collect-obproxy-metrics at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.lockAndExec(ObproxySchedules.java:34) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.collectObproxyMetrics(ObproxySchedules.java:29) at sun.reflect.GeneratedMethodAccessor502.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.380 ERROR 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 2 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.fetchAfterId(SeriesKeyIdPersistent.java:84) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.fetchAfterId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.fetchAfterId(SeriesIdKeyService.java:101) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 2 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.380 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-06-04 10:48:57.380 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435041944875008 2024-06-04 10:48:57.465 WARN 77632 --- [pool-ocp-schedules-18,861c274a08e54406,154a31dddd45] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.466 ERROR 77632 --- [pool-ocp-schedules-18,861c274a08e54406,154a31dddd45] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 48, createErrorCount 8 2024-06-04 10:48:57.468 ERROR 77632 --- [pool-ocp-schedules-18,861c274a08e54406,154a31dddd45] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 48, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.581 WARN 77632 --- [pool-ocp-schedules-15,6d3bf8653b6245a8,22cf080a17cc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.581 ERROR 77632 --- [pool-ocp-schedules-15,6d3bf8653b6245a8,22cf080a17cc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 164, createErrorCount 8 2024-06-04 10:48:57.584 ERROR 77632 --- [pool-ocp-schedules-15,6d3bf8653b6245a8,22cf080a17cc] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 164, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.609 WARN 77632 --- [pool-ocp-schedules-4,ffed74b15ec2407d,b6e02759c970] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:57.806 WARN 77632 --- [pool-ocp-schedules-2,deafbffea6134c03,1b40010ba28c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.806 ERROR 77632 --- [pool-ocp-schedules-2,deafbffea6134c03,1b40010ba28c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 389, createErrorCount 8 2024-06-04 10:48:57.806 ERROR 77632 --- [pool-ocp-schedules-2,deafbffea6134c03,1b40010ba28c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 389, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.893 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:57.899 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.899 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 482, createErrorCount 8 2024-06-04 10:48:57.899 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:48:57.911 WARN 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.911 ERROR 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 494, createErrorCount 8 2024-06-04 10:48:57.912 ERROR 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 494, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:57.912 INFO 77632 --- [pool-prometheus-minute-schedule-1,6756c0476ee948ce,872e69992f92] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469333911, count=0, elapsed=4001 2024-06-04 10:48:57.912 INFO 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469340, interval=60 2024-06-04 10:48:57.990 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:57.990 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 573, createErrorCount 8 2024-06-04 10:48:57.990 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:48:58.141 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:58.141 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 724, createErrorCount 8 2024-06-04 10:48:58.141 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:48:58.271 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:58.271 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 854, createErrorCount 8 2024-06-04 10:48:58.272 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 854, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:58.687 WARN 77632 --- [pool-ocp-schedules-6,ce5a7e72760e40b5,5334f185c09e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:58.689 WARN 77632 --- [pool-ocp-schedules-10,6758858334214273,a54cfd01f91b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:58.690 WARN 77632 --- [pool-ocp-schedules-17,fa3e9ff2179d4530,a976c348ba58] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:58.735 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:58.736 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1318, createErrorCount 8 2024-06-04 10:48:58.736 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1318, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:58.874 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:58.890 WARN 77632 --- [pool-ocp-schedules-16,65a4a5290ade49c7,5f9fef44fb1a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:58.935 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.016 WARN 77632 --- [pool-ocp-async-5,25503e416d924480,1eeb33fc1fd4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.016 INFO 77632 --- [pool-ocp-async-4,08db6d6b3ac44eaf,bb896377a731] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:48:59.016 WARN 77632 --- [pool-ocp-async-9,c93816cdaeae44d0,2d1fdadbea75] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:59.016 ERROR 77632 --- [pool-ocp-async-9,c93816cdaeae44d0,2d1fdadbea75] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1599, createErrorCount 8 2024-06-04 10:48:59.016 WARN 77632 --- [pool-ocp-async-6,809bd35622974edc,5c3c705a7c47] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.017 WARN 77632 --- [pool-ocp-async-8,f89ba7d4b4af49a9,111da0c8a125] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.022 WARN 77632 --- [pool-ocp-async-10,9af8f4bdbf344e19,6e956e16bc74] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:59.022 ERROR 77632 --- [pool-ocp-async-10,9af8f4bdbf344e19,6e956e16bc74] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1605, createErrorCount 8 2024-06-04 10:48:59.025 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:59.026 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1608, createErrorCount 8 2024-06-04 10:48:59.026 WARN 77632 --- [pool-ocp-async-4,08db6d6b3ac44eaf,bb896377a731] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:48:59.026 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObClusterAlarmTarget(ObAlarmTargetProvider.java:76) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1608, createErrorCount 8 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:59.382 WARN 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.390 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:59.419 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:59.609 WARN 77632 --- [pool-ocp-schedules-4,ffed74b15ec2407d,b6e02759c970] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:59.609 ERROR 77632 --- [pool-ocp-schedules-4,ffed74b15ec2407d,b6e02759c970] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 2024-06-04 10:48:59.610 ERROR 77632 --- [pool-ocp-schedules-4,ffed74b15ec2407d,b6e02759c970] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.resolveAlarms(OcpAlarmSearchService.java:531) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.resolveAlarmsOfAbsentTargets(AlarmSchedules.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:59.837 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.846 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:48:59.893 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:48:59.893 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 2024-06-04 10:48:59.893 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:48:59.913 WARN 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:00.270 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:00.313 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:00.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:49:00.690 WARN 77632 --- [pool-ocp-schedules-10,6758858334214273,a54cfd01f91b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:00.690 ERROR 77632 --- [pool-ocp-schedules-10,6758858334214273,a54cfd01f91b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 770, createErrorCount 9 2024-06-04 10:49:00.690 WARN 77632 --- [pool-ocp-schedules-17,fa3e9ff2179d4530,a976c348ba58] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:00.690 ERROR 77632 --- [pool-ocp-schedules-17,fa3e9ff2179d4530,a976c348ba58] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 770, createErrorCount 9 2024-06-04 10:49:00.690 ERROR 77632 --- [pool-ocp-schedules-10,6758858334214273,a54cfd01f91b] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.core.notification.NotificationSender.refresh(NotificationSender.java:114) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmInMemtory(AlarmSchedules.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 770, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 34 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:00.693 WARN 77632 --- [pool-ocp-schedules-6,ce5a7e72760e40b5,5334f185c09e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:00.693 ERROR 77632 --- [pool-ocp-schedules-6,ce5a7e72760e40b5,5334f185c09e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2005, active 0, maxActive 200, creating 1, createElapseMillis 773, createErrorCount 9 2024-06-04 10:49:00.693 ERROR 77632 --- [pool-ocp-schedules-17,fa3e9ff2179d4530,a976c348ba58] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 770, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:00.693 ERROR 77632 --- [pool-ocp-schedules-6,ce5a7e72760e40b5,5334f185c09e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.refreshActiveAlarmStatus(OcpAlarmSearchService.java:508) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshActiveAlarmStatus(AlarmSchedules.java:89) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2005, active 0, maxActive 200, creating 1, createElapseMillis 773, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 67 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:00.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:49:00.874 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:00.874 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 954, createErrorCount 9 2024-06-04 10:49:00.875 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 954, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:00.890 WARN 77632 --- [pool-ocp-schedules-16,65a4a5290ade49c7,5f9fef44fb1a] o.s.jdbc.support.SQLErrorCodesFactory : Error while extracting database name org.springframework.jdbc.support.MetaDataAccessException: Could not get Connection for extracting meta-data; nested exception is org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 999, createErrorCount 3 at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:363) at org.springframework.jdbc.support.SQLErrorCodesFactory.resolveErrorCodes(SQLErrorCodesFactory.java:235) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.lambda$setDataSource$0(SQLErrorCodeSQLExceptionTranslator.java:140) at org.springframework.util.function.SingletonSupplier.get(SingletonSupplier.java:97) at org.springframework.util.function.SupplierUtils.resolve(SupplierUtils.java:40) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.getSqlErrorCodes(SQLErrorCodeSQLExceptionTranslator.java:171) at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.doTranslate(SQLErrorCodeSQLExceptionTranslator.java:193) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:70) at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1583) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:398) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:513) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:520) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDb(HealthCheckService.java:188) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMonitorDbHealth(HealthCheckService.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 999, createErrorCount 3 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.support.JdbcUtils.extractDatabaseMetaData(JdbcUtils.java:337) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 999, createErrorCount 3 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:00.897 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:00.900 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:00.935 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1015, createErrorCount 9 2024-06-04 10:49:00.991 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.016 WARN 77632 --- [pool-ocp-async-7,cc85d0ec7d0248ca,5ccd13045608] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.016 WARN 77632 --- [pool-ocp-async-2,bcf7583521b3495f,7851a002b3b9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.016 WARN 77632 --- [pool-ocp-async-5,25503e416d924480,1eeb33fc1fd4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:01.016 ERROR 77632 --- [pool-ocp-async-5,25503e416d924480,1eeb33fc1fd4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1096, createErrorCount 9 2024-06-04 10:49:01.016 INFO 77632 --- [pool-ocp-async-9,32cab035fb034299,0b1876851808] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:01.016 WARN 77632 --- [pool-ocp-async-6,809bd35622974edc,5c3c705a7c47] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:01.016 ERROR 77632 --- [pool-ocp-async-6,809bd35622974edc,5c3c705a7c47] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1096, createErrorCount 9 2024-06-04 10:49:01.018 WARN 77632 --- [pool-ocp-async-8,f89ba7d4b4af49a9,111da0c8a125] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:01.018 ERROR 77632 --- [pool-ocp-async-8,f89ba7d4b4af49a9,111da0c8a125] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1098, createErrorCount 9 2024-06-04 10:49:01.027 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.113 INFO 77632 --- [pool-metric-parse-7,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469340, message=java.util.concurrent.TimeoutException: Read timeout to 192.168.5.252/192.168.5.252:62889 after 1000 ms, rootCause=TimeoutException: Read timeout to 192.168.5.252/192.168.5.252:62889 after 1000 ms 2024-06-04 10:49:01.141 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.272 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.383 ERROR 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1491, createErrorCount 3 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent.fetchAfterId(MeasurementIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$FastClassBySpringCGLIB$$278002a9.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$EnhancerBySpringCGLIB$$1eefe4e.fetchAfterId() at com.oceanbase.ocp.monitor.service.MeasurementIdService.fetchAfterId(MeasurementIdService.java:32) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1491, createErrorCount 3 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:01.383 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-06-04 10:49:01.383 INFO 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435043945558016 2024-06-04 10:49:01.732 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.736 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:01.838 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1918, createErrorCount 9 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1918, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:01.838 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:01.846 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:01.846 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1926, createErrorCount 9 2024-06-04 10:49:01.849 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1926, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:01.893 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:01.913 WARN 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:01.913 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1993, createErrorCount 9 2024-06-04 10:49:01.913 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1993, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:01.913 INFO 77632 --- [pool-prometheus-minute-schedule-1,7f3cdd423b3b46a4,5b17f2f27f4b] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469337912, count=0, elapsed=4001 2024-06-04 10:49:01.913 INFO 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:01.924 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:02.000 WARN 77632 --- [pool-ocp-schedules-19,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:02.270 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:02.270 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 10 2024-06-04 10:49:02.270 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:02.313 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:02.313 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 10 2024-06-04 10:49:02.313 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:02.694 INFO 77632 --- [pool-ocp-async-4,99777871e5164142,b2107ca384b8] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:02.722 WARN 77632 --- [pool-scanner-12254-1,99777871e5164142,80ac6077babc] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:02.867 INFO 77632 --- [pool-ocp-async-10,7c016f4a2ded4abd,eb4d5e52be17] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:02.897 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:02.897 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 472, createErrorCount 10 2024-06-04 10:49:02.898 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 472, createErrorCount 10 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:02.900 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:02.900 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 475, createErrorCount 10 2024-06-04 10:49:02.900 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:02.936 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:02.991 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:02.991 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 566, createErrorCount 10 2024-06-04 10:49:02.991 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:03.016 WARN 77632 --- [pool-ocp-async-3,1847b9fcd5a141d7,28a1a3473878] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:03.016 WARN 77632 --- [pool-ocp-async-7,cc85d0ec7d0248ca,5ccd13045608] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.016 ERROR 77632 --- [pool-ocp-async-7,cc85d0ec7d0248ca,5ccd13045608] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 591, createErrorCount 10 2024-06-04 10:49:03.016 WARN 77632 --- [pool-ocp-async-1,0f4b604e1ca04811,e2d17dc3eaa1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:03.016 WARN 77632 --- [pool-ocp-async-2,bcf7583521b3495f,7851a002b3b9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.016 ERROR 77632 --- [pool-ocp-async-2,bcf7583521b3495f,7851a002b3b9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 591, createErrorCount 10 2024-06-04 10:49:03.016 INFO 77632 --- [pool-ocp-async-7,19c6dd30cabd4af5,777b0dc7556e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:03.018 WARN 77632 --- [pool-ocp-async-9,32cab035fb034299,0b1876851808] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:03.026 WARN 77632 --- [pool-ocp-async-7,19c6dd30cabd4af5,777b0dc7556e] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:03.027 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.027 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 602, createErrorCount 10 2024-06-04 10:49:03.027 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObTenantAlarmTarget(ObAlarmTargetProvider.java:110) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 46 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 602, createErrorCount 10 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 50 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:03.142 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.142 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 717, createErrorCount 10 2024-06-04 10:49:03.142 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:03.272 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.272 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 847, createErrorCount 10 2024-06-04 10:49:03.273 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 847, createErrorCount 10 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:03.385 WARN 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:03.732 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.732 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1307, createErrorCount 10 2024-06-04 10:49:03.732 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:03.736 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:03.737 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1311, createErrorCount 10 2024-06-04 10:49:03.737 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1311, createErrorCount 10 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:03.914 WARN 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.001 ERROR 77632 --- [pool-ocp-schedules-19,,] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1575, createErrorCount 10 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:968) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1023) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1033) at com.oceanbase.ocp.server.common.config.SpringSessionConfiguration$CustomizedJdbcIndexedSessionRepository.cleanUpExpiredSessions(SpringSessionConfiguration.java:115) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1575, createErrorCount 10 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 14 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:04.396 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:04.427 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:04.695 WARN 77632 --- [alarm-detect-13,99777871e5164142,4160aa0b5758] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.695 WARN 77632 --- [alarm-detect-26,99777871e5164142,b26577b8c4c0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.696 WARN 77632 --- [alarm-detect-27,99777871e5164142,4932e8ad9562] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.696 WARN 77632 --- [alarm-detect-9,99777871e5164142,f03188bd0117] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.697 WARN 77632 --- [alarm-detect-10,99777871e5164142,2e57568b2480] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.697 WARN 77632 --- [alarm-detect-5,99777871e5164142,e60a800c8ce5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.697 WARN 77632 --- [alarm-detect-14,99777871e5164142,571b463fd7bc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-1,99777871e5164142,3723d588603c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-29,99777871e5164142,65ce0462bdce] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-6,99777871e5164142,9febd5716320] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-24,99777871e5164142,b53c56ed9526] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-19,99777871e5164142,c1fa810d51d0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-17,99777871e5164142,b19e2b7734ba] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-3,99777871e5164142,39aa0a9b8fe3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-11,99777871e5164142,bcad194a6e67] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-2,99777871e5164142,cc55f7d5b314] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-18,99777871e5164142,02a6bcb64395] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-30,99777871e5164142,511fda3c1609] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.699 WARN 77632 --- [alarm-detect-4,99777871e5164142,78f9d8213ad9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.705 WARN 77632 --- [alarm-detect-16,99777871e5164142,83d4656e6e90] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.707 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.720 WARN 77632 --- [alarm-detect-8,99777871e5164142,9b5dd5c35bb5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.729 WARN 77632 --- [alarm-detect-20,99777871e5164142,655c6185dcab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.731 WARN 77632 --- [alarm-detect-22,99777871e5164142,5de99dea64c2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.860 WARN 77632 --- [pool-overview-container-7,c45a4bb962ab42d5,5b764fda3d7d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.860 WARN 77632 --- [pool-overview-container-6,2a9b0752a5414fd9,6c8aaafdb9f7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.860 WARN 77632 --- [pool-overview-container-8,3c1bd7c01fa94ecf,d67722096913] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.860 WARN 77632 --- [pool-overview-container-3,8a988460192747a7,0f06e5ca1ef2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.867 WARN 77632 --- [pool-ocp-async-10,7c016f4a2ded4abd,eb4d5e52be17] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.872 WARN 77632 --- [pool-overview-container-2,d9e6b9f3df964134,31e4c05e9a20] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.879 WARN 77632 --- [pool-overview-container-5,661340e98c6e4b74,42e4276bc957] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.894 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:04.936 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 8, createErrorCount 11 2024-06-04 10:49:05.016 WARN 77632 --- [pool-ocp-async-5,77020b38df63419f,fc66bf7fbab6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:05.016 WARN 77632 --- [pool-ocp-async-8,fdc3b37510a24027,01789ced22da] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:05.016 WARN 77632 --- [pool-ocp-async-3,1847b9fcd5a141d7,28a1a3473878] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.016 ERROR 77632 --- [pool-ocp-async-3,1847b9fcd5a141d7,28a1a3473878] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 88, createErrorCount 11 2024-06-04 10:49:05.016 INFO 77632 --- [pool-ocp-async-3,a14b0b91533741d8,190a06b5e831] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:05.017 WARN 77632 --- [pool-ocp-async-1,0f4b604e1ca04811,e2d17dc3eaa1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.017 ERROR 77632 --- [pool-ocp-async-1,0f4b604e1ca04811,e2d17dc3eaa1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 89, createErrorCount 11 2024-06-04 10:49:05.018 WARN 77632 --- [pool-ocp-async-9,32cab035fb034299,0b1876851808] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.018 ERROR 77632 --- [pool-ocp-async-9,32cab035fb034299,0b1876851808] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 90, createErrorCount 11 2024-06-04 10:49:05.028 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:05.386 ERROR 77632 --- [pool-ocp-schedules-5,04bf0ae20f194a07,b26f2b49d887] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 486, createErrorCount 5 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent.fetchAfterId(RecordKeyIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$FastClassBySpringCGLIB$$c73c5afb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$EnhancerBySpringCGLIB$$556cca84.fetchAfterId() at com.oceanbase.ocp.monitor.service.RecordIdKeyService.fetchAfterId(RecordIdKeyService.java:113) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 486, createErrorCount 5 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:05.730 WARN 77632 --- [pool-ocp-async-4,99777871e5164142,b2107ca384b8] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:49:05.730 WARN 77632 --- [alarm-detect-13,99777871e5164142,4160aa0b5758] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.730 ERROR 77632 --- [alarm-detect-13,99777871e5164142,4160aa0b5758] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.730 WARN 77632 --- [alarm-detect-26,99777871e5164142,b26577b8c4c0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.730 ERROR 77632 --- [alarm-detect-26,99777871e5164142,b26577b8c4c0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.730 WARN 77632 --- [alarm-detect-14,99777871e5164142,571b463fd7bc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.730 ERROR 77632 --- [alarm-detect-14,99777871e5164142,571b463fd7bc] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.730 WARN 77632 --- [alarm-detect-2,99777871e5164142,cc55f7d5b314] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.730 ERROR 77632 --- [alarm-detect-2,99777871e5164142,cc55f7d5b314] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.731 WARN 77632 --- [alarm-detect-9,99777871e5164142,f03188bd0117] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.731 ERROR 77632 --- [alarm-detect-9,99777871e5164142,f03188bd0117] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.735 ERROR 77632 --- [alarm-detect-2,99777871e5164142,cc55f7d5b314] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=backup_storage_capacity_retry_times_exceeded org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.735 WARN 77632 --- [alarm-detect-16,99777871e5164142,83d4656e6e90] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.735 ERROR 77632 --- [alarm-detect-16,99777871e5164142,83d4656e6e90] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.736 ERROR 77632 --- [alarm-detect-26,99777871e5164142,b26577b8c4c0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.736 ERROR 77632 --- [alarm-detect-16,99777871e5164142,83d4656e6e90] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_cannot_connect_to_leader org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.736 ERROR 77632 --- [alarm-detect-9,99777871e5164142,f03188bd0117] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_log_disk_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.736 WARN 77632 --- [alarm-detect-10,99777871e5164142,2e57568b2480] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-10,99777871e5164142,2e57568b2480] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-14,99777871e5164142,571b463fd7bc] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_recyclebin_disk_used_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.737 WARN 77632 --- [alarm-detect-1,99777871e5164142,3723d588603c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-1,99777871e5164142,3723d588603c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-10,99777871e5164142,2e57568b2480] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_hwm org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.737 WARN 77632 --- [alarm-detect-5,99777871e5164142,e60a800c8ce5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-5,99777871e5164142,e60a800c8ce5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.737 ERROR 77632 --- [alarm-detect-1,99777871e5164142,3723d588603c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_net_send_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.738 ERROR 77632 --- [alarm-detect-5,99777871e5164142,e60a800c8ce5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxy_cannot_connected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.738 WARN 77632 --- [alarm-detect-6,99777871e5164142,9febd5716320] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.738 ERROR 77632 --- [alarm-detect-6,99777871e5164142,9febd5716320] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.738 ERROR 77632 --- [alarm-detect-13,99777871e5164142,4160aa0b5758] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_cannot_connect_arbitration org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.738 ERROR 77632 --- [alarm-detect-6,99777871e5164142,9febd5716320] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=refresh_location_cache_failed_by_metric org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.742 WARN 77632 --- [alarm-detect-24,99777871e5164142,b53c56ed9526] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.742 ERROR 77632 --- [alarm-detect-24,99777871e5164142,b53c56ed9526] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.742 WARN 77632 --- [alarm-detect-3,99777871e5164142,39aa0a9b8fe3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.742 ERROR 77632 --- [alarm-detect-3,99777871e5164142,39aa0a9b8fe3] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.742 ERROR 77632 --- [alarm-detect-3,99777871e5164142,39aa0a9b8fe3] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_nvme_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.742 WARN 77632 --- [alarm-detect-20,99777871e5164142,655c6185dcab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.742 ERROR 77632 --- [alarm-detect-20,99777871e5164142,655c6185dcab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.743 ERROR 77632 --- [alarm-detect-20,99777871e5164142,655c6185dcab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.742 ERROR 77632 --- [alarm-detect-24,99777871e5164142,b53c56ed9526] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ic_server_connect_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.743 WARN 77632 --- [alarm-detect-11,99777871e5164142,bcad194a6e67] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.743 ERROR 77632 --- [alarm-detect-11,99777871e5164142,bcad194a6e67] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.744 WARN 77632 --- [alarm-detect-22,99777871e5164142,5de99dea64c2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.744 ERROR 77632 --- [alarm-detect-22,99777871e5164142,5de99dea64c2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.744 ERROR 77632 --- [alarm-detect-11,99777871e5164142,bcad194a6e67] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.744 WARN 77632 --- [alarm-detect-8,99777871e5164142,9b5dd5c35bb5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.744 ERROR 77632 --- [alarm-detect-8,99777871e5164142,9b5dd5c35bb5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.744 ERROR 77632 --- [alarm-detect-22,99777871e5164142,5de99dea64c2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_nic_usage_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.744 ERROR 77632 --- [alarm-detect-8,99777871e5164142,9b5dd5c35bb5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_ip_forward_invalid org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.745 WARN 77632 --- [alarm-detect-4,99777871e5164142,78f9d8213ad9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.745 ERROR 77632 --- [alarm-detect-4,99777871e5164142,78f9d8213ad9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.745 WARN 77632 --- [alarm-detect-18,99777871e5164142,02a6bcb64395] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.745 ERROR 77632 --- [alarm-detect-18,99777871e5164142,02a6bcb64395] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.745 ERROR 77632 --- [alarm-detect-4,99777871e5164142,78f9d8213ad9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=arbitration_service_unavailable org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.745 ERROR 77632 --- [alarm-detect-18,99777871e5164142,02a6bcb64395] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_active_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.745 WARN 77632 --- [alarm-detect-30,99777871e5164142,511fda3c1609] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.745 ERROR 77632 --- [alarm-detect-30,99777871e5164142,511fda3c1609] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.746 ERROR 77632 --- [alarm-detect-30,99777871e5164142,511fda3c1609] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obagent_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.746 WARN 77632 --- [alarm-detect-27,99777871e5164142,4932e8ad9562] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.746 ERROR 77632 --- [alarm-detect-27,99777871e5164142,4932e8ad9562] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.747 WARN 77632 --- [alarm-detect-29,99777871e5164142,65ce0462bdce] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.747 ERROR 77632 --- [alarm-detect-29,99777871e5164142,65ce0462bdce] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.747 WARN 77632 --- [alarm-detect-19,99777871e5164142,c1fa810d51d0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.747 ERROR 77632 --- [alarm-detect-19,99777871e5164142,c1fa810d51d0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.748 WARN 77632 --- [alarm-detect-17,99777871e5164142,b19e2b7734ba] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.748 ERROR 77632 --- [alarm-detect-17,99777871e5164142,b19e2b7734ba] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:05.748 ERROR 77632 --- [alarm-detect-17,99777871e5164142,b19e2b7734ba] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.754 ERROR 77632 --- [alarm-detect-27,99777871e5164142,4932e8ad9562] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_partition_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.755 ERROR 77632 --- [alarm-detect-29,99777871e5164142,65ce0462bdce] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_sda_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.756 ERROR 77632 --- [alarm-detect-19,99777871e5164142,c1fa810d51d0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_sync_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:05.875 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:05.902 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:05.914 WARN 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:05.914 ERROR 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 986, createErrorCount 11 2024-06-04 10:49:05.914 ERROR 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 986, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:05.915 INFO 77632 --- [pool-prometheus-minute-schedule-1,80d50b4bb5a34d54,4db73606dcbd] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469341913, count=0, elapsed=4002 2024-06-04 10:49:05.915 INFO 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:05.991 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.142 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.274 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.708 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.708 ERROR 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1779, createErrorCount 11 2024-06-04 10:49:06.710 ERROR 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy339.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterSnapshots(RecordingRuleLabelMatchContainer.java:219) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:75) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1779, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.737 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.838 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.854 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:06.860 WARN 77632 --- [pool-overview-container-6,2a9b0752a5414fd9,6c8aaafdb9f7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.860 WARN 77632 --- [pool-overview-container-3,8a988460192747a7,0f06e5ca1ef2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.860 WARN 77632 --- [pool-overview-container-8,3c1bd7c01fa94ecf,d67722096913] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.860 ERROR 77632 --- [pool-overview-container-8,3c1bd7c01fa94ecf,d67722096913] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 2024-06-04 10:49:06.863 ERROR 77632 --- [pool-overview-container-8,3c1bd7c01fa94ecf,d67722096913] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.863 WARN 77632 --- [pool-overview-container-8,3c1bd7c01fa94ecf,d67722096913] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.860 WARN 77632 --- [pool-overview-container-7,c45a4bb962ab42d5,5b764fda3d7d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.860 ERROR 77632 --- [pool-overview-container-6,2a9b0752a5414fd9,6c8aaafdb9f7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 2024-06-04 10:49:06.860 ERROR 77632 --- [pool-overview-container-3,8a988460192747a7,0f06e5ca1ef2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 2024-06-04 10:49:06.864 ERROR 77632 --- [pool-overview-container-7,c45a4bb962ab42d5,5b764fda3d7d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 2024-06-04 10:49:06.864 ERROR 77632 --- [pool-overview-container-3,8a988460192747a7,0f06e5ca1ef2] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.864 ERROR 77632 --- [pool-overview-container-6,2a9b0752a5414fd9,6c8aaafdb9f7] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.864 ERROR 77632 --- [pool-overview-container-7,c45a4bb962ab42d5,5b764fda3d7d] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.865 WARN 77632 --- [pool-overview-container-3,8a988460192747a7,0f06e5ca1ef2] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.865 WARN 77632 --- [pool-overview-container-6,2a9b0752a5414fd9,6c8aaafdb9f7] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.865 WARN 77632 --- [pool-overview-container-7,c45a4bb962ab42d5,5b764fda3d7d] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.867 WARN 77632 --- [pool-ocp-async-10,7c016f4a2ded4abd,eb4d5e52be17] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.867 ERROR 77632 --- [pool-ocp-async-10,7c016f4a2ded4abd,eb4d5e52be17] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1939, createErrorCount 11 2024-06-04 10:49:06.872 WARN 77632 --- [pool-overview-container-2,d9e6b9f3df964134,31e4c05e9a20] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.872 ERROR 77632 --- [pool-overview-container-2,d9e6b9f3df964134,31e4c05e9a20] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 11 2024-06-04 10:49:06.873 ERROR 77632 --- [pool-overview-container-2,d9e6b9f3df964134,31e4c05e9a20] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.873 WARN 77632 --- [pool-overview-container-2,d9e6b9f3df964134,31e4c05e9a20] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.879 WARN 77632 --- [pool-overview-container-5,661340e98c6e4b74,42e4276bc957] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.879 ERROR 77632 --- [pool-overview-container-5,661340e98c6e4b74,42e4276bc957] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1951, createErrorCount 11 2024-06-04 10:49:06.880 ERROR 77632 --- [pool-overview-container-5,661340e98c6e4b74,42e4276bc957] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1951, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.880 WARN 77632 --- [pool-overview-container-5,661340e98c6e4b74,42e4276bc957] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1951, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.894 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:06.894 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1966, createErrorCount 11 2024-06-04 10:49:06.895 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1966, createErrorCount 11 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.902 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.930 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:06.936 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.016 WARN 77632 --- [pool-ocp-async-2,ba8d605b546b4ee4,e66646ae9931] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.016 WARN 77632 --- [pool-ocp-async-8,fdc3b37510a24027,01789ced22da] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.016 ERROR 77632 --- [pool-ocp-async-8,fdc3b37510a24027,01789ced22da] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 12 2024-06-04 10:49:07.016 WARN 77632 --- [pool-ocp-async-5,77020b38df63419f,fc66bf7fbab6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.016 ERROR 77632 --- [pool-ocp-async-5,77020b38df63419f,fc66bf7fbab6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 12 2024-06-04 10:49:07.017 INFO 77632 --- [pool-ocp-async-5,c44d7f7205b94a54,3fbad1e23071] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:07.016 WARN 77632 --- [pool-ocp-async-7,4a821a1991c74b3c,3b7cd0cfca35] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.018 WARN 77632 --- [pool-ocp-async-3,a14b0b91533741d8,190a06b5e831] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.027 WARN 77632 --- [pool-ocp-async-5,c44d7f7205b94a54,3fbad1e23071] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:07.028 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.028 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 12 2024-06-04 10:49:07.029 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObServerAlarmTarget(ObAlarmTargetProvider.java:164) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:07.807 INFO 77632 --- [pool-ocp-schedules-7,2429489d0f1e4848,b307a1473fce] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:49:07.875 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.875 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 444, createErrorCount 12 2024-06-04 10:49:07.876 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 444, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:07.898 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.903 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.903 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 472, createErrorCount 12 2024-06-04 10:49:07.903 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:07.915 WARN 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:07.992 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:07.992 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 560, createErrorCount 12 2024-06-04 10:49:07.992 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:08.142 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:08.142 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 711, createErrorCount 12 2024-06-04 10:49:08.143 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:08.275 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:08.275 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 843, createErrorCount 12 2024-06-04 10:49:08.275 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 843, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:08.300 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:08.711 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:08.738 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:08.738 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1306, createErrorCount 12 2024-06-04 10:49:08.738 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1306, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:08.839 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1407, createErrorCount 12 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1407, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:08.839 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:08.854 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:08.855 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1423, createErrorCount 12 2024-06-04 10:49:08.855 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1423, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:08.937 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1505, createErrorCount 12 2024-06-04 10:49:09.016 INFO 77632 --- [pool-ocp-async-4,fc8713e3c2f3456e,40ec1c4b980d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:09.016 WARN 77632 --- [pool-ocp-async-2,ba8d605b546b4ee4,e66646ae9931] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:09.016 ERROR 77632 --- [pool-ocp-async-2,ba8d605b546b4ee4,e66646ae9931] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1585, createErrorCount 12 2024-06-04 10:49:09.016 WARN 77632 --- [pool-ocp-async-8,d1faf76df0d04622,405f09fe8610] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.016 WARN 77632 --- [pool-ocp-async-1,77021a2974a7464c,215efca85326] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.017 WARN 77632 --- [pool-ocp-async-7,4a821a1991c74b3c,3b7cd0cfca35] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:09.017 ERROR 77632 --- [pool-ocp-async-7,4a821a1991c74b3c,3b7cd0cfca35] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1586, createErrorCount 12 2024-06-04 10:49:09.018 WARN 77632 --- [pool-ocp-async-3,a14b0b91533741d8,190a06b5e831] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:09.018 ERROR 77632 --- [pool-ocp-async-3,a14b0b91533741d8,190a06b5e831] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1587, createErrorCount 12 2024-06-04 10:49:09.029 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.271 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.313 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.404 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:09.433 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:09.469 WARN 77632 --- [pool-ocp-schedules-6,72add6821ccb487b,be9adcc1ff0a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.807 WARN 77632 --- [pool-ocp-schedules-7,2429489d0f1e4848,b307a1473fce] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:09.898 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:09.898 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 13 2024-06-04 10:49:09.899 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:09.915 WARN 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:09.915 ERROR 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 13 2024-06-04 10:49:09.916 ERROR 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:09.916 INFO 77632 --- [pool-prometheus-minute-schedule-1,2d9ace11c83e4d25,61a12a90e261] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469345915, count=0, elapsed=4001 2024-06-04 10:49:09.916 INFO 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:10.300 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 366, createErrorCount 13 2024-06-04 10:49:10.711 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:10.711 ERROR 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 777, createErrorCount 13 2024-06-04 10:49:10.714 ERROR 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterTenantSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy364.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterTenantSnapshots(RecordingRuleLabelMatchContainer.java:248) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:76) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 777, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:10.732 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:10.903 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:10.937 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:10.992 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.016 WARN 77632 --- [pool-ocp-async-9,4bbd39b811ca4411,10ee16684bee] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.016 WARN 77632 --- [pool-ocp-async-10,2570293cea9f4582,0580892638ec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.017 INFO 77632 --- [pool-ocp-async-2,c190d780c47d44f8,2b3deee5bf55] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:11.017 WARN 77632 --- [pool-ocp-async-1,77021a2974a7464c,215efca85326] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.017 WARN 77632 --- [pool-ocp-async-8,d1faf76df0d04622,405f09fe8610] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.017 ERROR 77632 --- [pool-ocp-async-1,77021a2974a7464c,215efca85326] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1083, createErrorCount 13 2024-06-04 10:49:11.017 ERROR 77632 --- [pool-ocp-async-8,d1faf76df0d04622,405f09fe8610] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1083, createErrorCount 13 2024-06-04 10:49:11.019 WARN 77632 --- [pool-ocp-async-4,fc8713e3c2f3456e,40ec1c4b980d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.027 WARN 77632 --- [pool-ocp-async-2,c190d780c47d44f8,2b3deee5bf55] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:11.029 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.030 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1095, createErrorCount 13 2024-06-04 10:49:11.030 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObServerLogAlarmTarget(ObAlarmTargetProvider.java:171) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1095, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:11.143 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.271 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.271 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1337, createErrorCount 13 2024-06-04 10:49:11.271 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:11.275 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.314 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.314 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1380, createErrorCount 13 2024-06-04 10:49:11.314 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:11.469 WARN 77632 --- [pool-ocp-schedules-6,72add6821ccb487b,be9adcc1ff0a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.469 ERROR 77632 --- [pool-ocp-schedules-6,72add6821ccb487b,be9adcc1ff0a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1535, createErrorCount 13 2024-06-04 10:49:11.470 ERROR 77632 --- [pool-ocp-schedules-6,72add6821ccb487b,be9adcc1ff0a] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1535, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:11.738 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.807 WARN 77632 --- [pool-ocp-schedules-7,2429489d0f1e4848,b307a1473fce] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:11.807 ERROR 77632 --- [pool-ocp-schedules-7,2429489d0f1e4848,b307a1473fce] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1873, createErrorCount 13 2024-06-04 10:49:11.808 ERROR 77632 --- [pool-ocp-schedules-7,2429489d0f1e4848,b307a1473fce] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1873, createErrorCount 13 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:11.896 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.907 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:11.916 WARN 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:11.936 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:12.694 WARN 77632 --- [pool-ocp-schedules-4,1deba4c05ff24e95,9ae5188bc8ba] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:12.694 INFO 77632 --- [pool-ocp-async-1,86171ccf983c4350,be08f512887c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:12.701 WARN 77632 --- [pool-scanner-12279-1,86171ccf983c4350,f443bfa33353] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:12.711 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:12.715 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:12.733 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:12.733 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 296, createErrorCount 14 2024-06-04 10:49:12.733 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:12.873 INFO 77632 --- [pool-ocp-async-2,40333638fb6640c6,a511b77546e2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:12.876 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:12.912 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:12.912 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2008, active 0, maxActive 200, creating 1, createElapseMillis 475, createErrorCount 14 2024-06-04 10:49:12.912 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:12.937 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 500, createErrorCount 14 2024-06-04 10:49:12.992 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:12.992 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 555, createErrorCount 14 2024-06-04 10:49:12.992 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:13.017 WARN 77632 --- [pool-ocp-async-3,f4adf1beefae421c,f123cd8acbe8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.017 WARN 77632 --- [pool-ocp-async-9,4bbd39b811ca4411,10ee16684bee] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.017 ERROR 77632 --- [pool-ocp-async-9,4bbd39b811ca4411,10ee16684bee] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 580, createErrorCount 14 2024-06-04 10:49:13.017 WARN 77632 --- [pool-ocp-async-10,2570293cea9f4582,0580892638ec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.017 ERROR 77632 --- [pool-ocp-async-10,2570293cea9f4582,0580892638ec] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 580, createErrorCount 14 2024-06-04 10:49:13.017 INFO 77632 --- [pool-ocp-async-7,91381313945846f5,17dd0863daff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:13.017 WARN 77632 --- [pool-ocp-async-5,44041be3db9940e6,e7b74531e247] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.019 WARN 77632 --- [pool-ocp-async-4,fc8713e3c2f3456e,40ec1c4b980d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.019 ERROR 77632 --- [pool-ocp-async-4,fc8713e3c2f3456e,40ec1c4b980d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 582, createErrorCount 14 2024-06-04 10:49:13.031 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.150 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.150 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2007, active 0, maxActive 200, creating 1, createElapseMillis 713, createErrorCount 14 2024-06-04 10:49:13.150 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:13.279 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.279 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 842, createErrorCount 14 2024-06-04 10:49:13.279 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 842, createErrorCount 14 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:13.739 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.739 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1302, createErrorCount 14 2024-06-04 10:49:13.739 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1302, createErrorCount 14 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:13.839 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.856 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.896 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.897 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1460, createErrorCount 14 2024-06-04 10:49:13.897 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1460, createErrorCount 14 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:13.915 WARN 77632 --- [pool-prometheus-exporter-check1,0576ebfc46684af0,e90e462af0fd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:13.916 WARN 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:13.916 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1479, createErrorCount 14 2024-06-04 10:49:13.917 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1479, createErrorCount 14 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:13.917 INFO 77632 --- [pool-prometheus-minute-schedule-1,e69f9e6288704321,bdd81181f82f] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469349916, count=0, elapsed=4001 2024-06-04 10:49:13.917 INFO 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:14.270 ERROR 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:49:14.270 INFO 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-06-04 10:49:14.305 ERROR 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:49:14.305 WARN 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : no ready nodes for cache. startTime = 1717469220 2024-06-04 10:49:14.305 INFO 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-06-04 10:49:14.410 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.439 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.694 WARN 77632 --- [pool-ocp-schedules-4,1deba4c05ff24e95,9ae5188bc8ba] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:14.694 ERROR 77632 --- [pool-ocp-schedules-4,1deba4c05ff24e95,9ae5188bc8ba] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 2024-06-04 10:49:14.695 ERROR 77632 --- [pool-ocp-schedules-4,1deba4c05ff24e95,9ae5188bc8ba] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.696 WARN 77632 --- [alarm-detect-15,86171ccf983c4350,f1c5f18aa6a2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.696 WARN 77632 --- [alarm-detect-2,86171ccf983c4350,95ea77d3af4a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.712 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] c.o.o.s.c.m.InnerExporterServiceImpl : Failed to collect ocp self-metrics org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:818) at org.springframework.jdbc.core.JdbcTemplate.queryForList(JdbcTemplate.java:935) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.querySeriesId(SeriesKeyIdPersistent.java:44) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.querySeriesId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.queryAndStoreToCache(SeriesIdKeyService.java:106) at com.oceanbase.ocp.monitor.service.IdKeyService.getId(IdKeyService.java:68) at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.getSeriesId(SeriesIdKeyService.java:89) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.mapMetricLines(RollupMetricDataStore.java:105) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.store(RollupMetricDataStore.java:86) at com.oceanbase.ocp.server.common.metrics.InnerExporterServiceImpl.collect(InnerExporterServiceImpl.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 9 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.716 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:14.716 ERROR 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 2024-06-04 10:49:14.716 WARN 77632 --- [pool-ocp-async-6,15a771f5c9de4e89,71944538d3be] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshObProxySnapshots(RecordingRuleLabelMatchContainer.java:269) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:77) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.863 WARN 77632 --- [pool-overview-container-3,f3acf7c977674d92,6b15cf3ff958] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.863 WARN 77632 --- [pool-overview-container-1,83ac48d9eb994e64,8a7cdd51d40a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.863 WARN 77632 --- [pool-overview-container-4,d87e0556e396496f,9adfc6d7fe18] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.863 WARN 77632 --- [pool-overview-container-8,4a8dc631ae0e4dda,70962e80d7ca] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.873 WARN 77632 --- [pool-overview-container-6,f6024d1d40c14b9f,a9b43e57e0e4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.874 WARN 77632 --- [pool-ocp-async-2,40333638fb6640c6,a511b77546e2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.877 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:14.877 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 2024-06-04 10:49:14.877 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:14.884 WARN 77632 --- [pool-overview-container-7,57d06b4337dc478c,4ebc2ab128f6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.900 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:14.937 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.017 WARN 77632 --- [pool-ocp-async-3,f4adf1beefae421c,f123cd8acbe8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.017 ERROR 77632 --- [pool-ocp-async-3,f4adf1beefae421c,f123cd8acbe8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 77, createErrorCount 15 2024-06-04 10:49:15.017 INFO 77632 --- [pool-ocp-async-6,6e71dd081f21415d,def8ff4dc32b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:15.017 WARN 77632 --- [pool-ocp-async-10,7dfa5f7a35574dcb,d22ae32b5f8a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.017 WARN 77632 --- [pool-ocp-async-5,44041be3db9940e6,e7b74531e247] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.017 ERROR 77632 --- [pool-ocp-async-5,44041be3db9940e6,e7b74531e247] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 77, createErrorCount 15 2024-06-04 10:49:15.017 WARN 77632 --- [pool-ocp-async-9,ed323c0b481c408f,85192aeb3620] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.019 WARN 77632 --- [pool-ocp-async-7,91381313945846f5,17dd0863daff] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.027 WARN 77632 --- [pool-ocp-async-6,6e71dd081f21415d,def8ff4dc32b] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:15.031 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.031 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 91, createErrorCount 15 2024-06-04 10:49:15.032 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyClusterAlarmTarget(ObproxyAlarmTargetProvider.java:55) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 91, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:15.763 WARN 77632 --- [pool-ocp-async-1,86171ccf983c4350,be08f512887c] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:49:15.763 WARN 77632 --- [alarm-detect-15,86171ccf983c4350,f1c5f18aa6a2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.764 ERROR 77632 --- [alarm-detect-15,86171ccf983c4350,f1c5f18aa6a2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:15.764 ERROR 77632 --- [alarm-detect-15,86171ccf983c4350,f1c5f18aa6a2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_observer_fd_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:15.768 WARN 77632 --- [alarm-detect-2,86171ccf983c4350,95ea77d3af4a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.768 ERROR 77632 --- [alarm-detect-2,86171ccf983c4350,95ea77d3af4a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:15.768 ERROR 77632 --- [alarm-detect-2,86171ccf983c4350,95ea77d3af4a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_sstable_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:15.840 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 900, createErrorCount 15 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 900, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:15.840 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:15.856 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.856 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 916, createErrorCount 15 2024-06-04 10:49:15.857 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 916, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:15.912 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.916 WARN 77632 --- [pool-prometheus-exporter-check1,0576ebfc46684af0,e90e462af0fd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,0576ebfc46684af0,e90e462af0fd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 976, createErrorCount 15 2024-06-04 10:49:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,0576ebfc46684af0,e90e462af0fd] c.o.ocp.monitor.OcpMonitorManager : checkActiveExporters failed: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.getAllExporterIdsWithSwitchOn(OcpExporterServiceImpl.java:178) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkActive(OcpExporterStatusCheckServiceImpl.java:87) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$3(OcpMonitorManager.java:144) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 976, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:15.917 WARN 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:15.993 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:16.112 INFO 77632 --- [pool-metric-parse-2,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469355, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:49:16.151 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:16.280 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:16.740 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-3,f3acf7c977674d92,6b15cf3ff958] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-3,f3acf7c977674d92,6b15cf3ff958] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-8,4a8dc631ae0e4dda,70962e80d7ca] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-8,4a8dc631ae0e4dda,70962e80d7ca] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-1,83ac48d9eb994e64,8a7cdd51d40a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-4,d87e0556e396496f,9adfc6d7fe18] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-1,83ac48d9eb994e64,8a7cdd51d40a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-4,d87e0556e396496f,9adfc6d7fe18] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-3,f3acf7c977674d92,6b15cf3ff958] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-1,83ac48d9eb994e64,8a7cdd51d40a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-8,4a8dc631ae0e4dda,70962e80d7ca] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-3,f3acf7c977674d92,6b15cf3ff958] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 ERROR 77632 --- [pool-overview-container-4,d87e0556e396496f,9adfc6d7fe18] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-1,83ac48d9eb994e64,8a7cdd51d40a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.865 WARN 77632 --- [pool-overview-container-4,d87e0556e396496f,9adfc6d7fe18] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.864 WARN 77632 --- [pool-overview-container-8,4a8dc631ae0e4dda,70962e80d7ca] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1924, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.874 WARN 77632 --- [pool-ocp-async-2,40333638fb6640c6,a511b77546e2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.874 ERROR 77632 --- [pool-ocp-async-2,40333638fb6640c6,a511b77546e2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 15 2024-06-04 10:49:16.874 WARN 77632 --- [pool-overview-container-6,f6024d1d40c14b9f,a9b43e57e0e4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.874 ERROR 77632 --- [pool-overview-container-6,f6024d1d40c14b9f,a9b43e57e0e4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 15 2024-06-04 10:49:16.874 ERROR 77632 --- [pool-overview-container-6,f6024d1d40c14b9f,a9b43e57e0e4] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.875 WARN 77632 --- [pool-overview-container-6,f6024d1d40c14b9f,a9b43e57e0e4] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.884 WARN 77632 --- [pool-overview-container-7,57d06b4337dc478c,4ebc2ab128f6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.884 ERROR 77632 --- [pool-overview-container-7,57d06b4337dc478c,4ebc2ab128f6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 15 2024-06-04 10:49:16.884 ERROR 77632 --- [pool-overview-container-7,57d06b4337dc478c,4ebc2ab128f6] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.884 WARN 77632 --- [pool-overview-container-7,57d06b4337dc478c,4ebc2ab128f6] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1944, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.900 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:16.900 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1960, createErrorCount 15 2024-06-04 10:49:16.900 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1960, createErrorCount 15 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.912 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:16.938 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1998, createErrorCount 15 2024-06-04 10:49:16.941 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:17.017 INFO 77632 --- [pool-ocp-async-5,d473b0a3b3f3466b,62a489c0e2a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:17.017 WARN 77632 --- [pool-ocp-async-4,f6e764fd2ccc46ac,0a5a4040d70e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:17.017 WARN 77632 --- [pool-ocp-async-8,f78b541b2a7b429b,92d2ecf1ce11] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:17.017 WARN 77632 --- [pool-ocp-async-10,7dfa5f7a35574dcb,d22ae32b5f8a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.017 ERROR 77632 --- [pool-ocp-async-10,7dfa5f7a35574dcb,d22ae32b5f8a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 16 2024-06-04 10:49:17.017 WARN 77632 --- [pool-ocp-async-9,ed323c0b481c408f,85192aeb3620] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.017 ERROR 77632 --- [pool-ocp-async-9,ed323c0b481c408f,85192aeb3620] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 16 2024-06-04 10:49:17.019 WARN 77632 --- [pool-ocp-async-7,91381313945846f5,17dd0863daff] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.019 ERROR 77632 --- [pool-ocp-async-7,91381313945846f5,17dd0863daff] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 16 2024-06-04 10:49:17.032 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:17.125 WARN 77632 --- [pool-metric-archive-second-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:17.912 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.913 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 471, createErrorCount 16 2024-06-04 10:49:17.913 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:17.917 WARN 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.918 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 476, createErrorCount 16 2024-06-04 10:49:17.918 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 476, createErrorCount 16 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:17.918 INFO 77632 --- [pool-prometheus-minute-schedule-1,3ee0dcb63fc44f04,0047c165dfc5] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469353917, count=0, elapsed=4001 2024-06-04 10:49:17.918 INFO 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:17.993 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:17.993 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 551, createErrorCount 16 2024-06-04 10:49:17.993 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:18.151 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:18.151 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 709, createErrorCount 16 2024-06-04 10:49:18.151 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:18.271 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:18.280 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:18.280 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 839, createErrorCount 16 2024-06-04 10:49:18.281 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 839, createErrorCount 16 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:18.314 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:18.740 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:18.740 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1298, createErrorCount 16 2024-06-04 10:49:18.740 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1298, createErrorCount 16 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:18.898 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:18.917 WARN 77632 --- [pool-prometheus-exporter-check2,ea0d56ad5f9f4499,546c6bc4e154] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:18.938 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.017 WARN 77632 --- [pool-ocp-async-3,ee768ec113964aab,7b7ef44c4e63] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.017 WARN 77632 --- [pool-ocp-async-8,f78b541b2a7b429b,92d2ecf1ce11] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:19.017 ERROR 77632 --- [pool-ocp-async-8,f78b541b2a7b429b,92d2ecf1ce11] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1576, createErrorCount 16 2024-06-04 10:49:19.017 INFO 77632 --- [pool-ocp-async-1,f5a0406cf34845f7,18976e89df1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:19.017 WARN 77632 --- [pool-ocp-async-4,f6e764fd2ccc46ac,0a5a4040d70e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:19.017 ERROR 77632 --- [pool-ocp-async-4,f6e764fd2ccc46ac,0a5a4040d70e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1576, createErrorCount 16 2024-06-04 10:49:19.017 WARN 77632 --- [pool-ocp-async-6,bacb6e009f81495f,c64670c106fc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.019 WARN 77632 --- [pool-ocp-async-5,d473b0a3b3f3466b,62a489c0e2a7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.027 WARN 77632 --- [pool-ocp-async-1,f5a0406cf34845f7,18976e89df1c] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:19.033 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:19.033 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1591, createErrorCount 16 2024-06-04 10:49:19.033 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyHostAlarmTarget(ObproxyAlarmTargetProvider.java:84) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1591, createErrorCount 16 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:19.125 ERROR 77632 --- [pool-metric-archive-second-2,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1712, createErrorCount 10 2024-06-04 10:49:19.415 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:19.443 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:19.585 WARN 77632 --- [pool-ocp-schedules-19,6f665f084397473a,e824cc75f3e3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.733 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.878 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:19.918 WARN 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:20.271 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:20.271 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 327, createErrorCount 17 2024-06-04 10:49:20.272 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:20.314 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:20.315 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 370, createErrorCount 17 2024-06-04 10:49:20.315 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:20.840 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:20.857 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:20.898 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:20.898 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 954, createErrorCount 17 2024-06-04 10:49:20.899 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 954, createErrorCount 17 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:20.913 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:20.918 WARN 77632 --- [pool-prometheus-exporter-check2,ea0d56ad5f9f4499,546c6bc4e154] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,ea0d56ad5f9f4499,546c6bc4e154] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 973, createErrorCount 17 2024-06-04 10:49:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,ea0d56ad5f9f4499,546c6bc4e154] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 973, createErrorCount 17 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 27 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:20.938 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 994, createErrorCount 17 2024-06-04 10:49:20.993 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.017 INFO 77632 --- [pool-ocp-async-9,5a9b3adff2554998,5f9149a6eb22] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:21.017 WARN 77632 --- [pool-ocp-async-3,ee768ec113964aab,7b7ef44c4e63] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.017 ERROR 77632 --- [pool-ocp-async-3,ee768ec113964aab,7b7ef44c4e63] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1073, createErrorCount 17 2024-06-04 10:49:21.017 WARN 77632 --- [pool-ocp-async-2,05b11f92db9f4068,270e617a042a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.017 WARN 77632 --- [pool-ocp-async-10,7440975bf17d432a,33944311a684] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.017 WARN 77632 --- [pool-ocp-async-6,bacb6e009f81495f,c64670c106fc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.017 ERROR 77632 --- [pool-ocp-async-6,bacb6e009f81495f,c64670c106fc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1073, createErrorCount 17 2024-06-04 10:49:21.020 WARN 77632 --- [pool-ocp-async-5,d473b0a3b3f3466b,62a489c0e2a7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.020 ERROR 77632 --- [pool-ocp-async-5,d473b0a3b3f3466b,62a489c0e2a7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1075, createErrorCount 17 2024-06-04 10:49:21.034 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.125 WARN 77632 --- [pool-metric-archive-second-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.151 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.281 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.585 WARN 77632 --- [pool-ocp-schedules-19,6f665f084397473a,e824cc75f3e3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.585 ERROR 77632 --- [pool-ocp-schedules-19,6f665f084397473a,e824cc75f3e3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1641, createErrorCount 17 2024-06-04 10:49:21.586 ERROR 77632 --- [pool-ocp-schedules-19,6f665f084397473a,e824cc75f3e3] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1641, createErrorCount 17 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:21.733 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.733 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1789, createErrorCount 17 2024-06-04 10:49:21.734 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:21.741 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.808 INFO 77632 --- [pool-ocp-schedules-6,22a67ed964e54bfe,f802a08e66b0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:49:21.878 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.878 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 17 2024-06-04 10:49:21.879 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 17 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:21.901 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:21.918 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:21.919 WARN 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:21.919 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1974, createErrorCount 17 2024-06-04 10:49:21.919 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1974, createErrorCount 17 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:21.919 INFO 77632 --- [pool-prometheus-minute-schedule-1,7a0814f204b54b9a,83bbf3a1d6fe] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469357918, count=0, elapsed=4001 2024-06-04 10:49:21.919 INFO 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:21.946 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:22.299 INFO 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=Ren_Test&version=2&ObClusterId=1717467632, client=0:0:0:0:0:0:0:1, traceId=f8f8baba11c94d84, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469360287260,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2024-06-04 10:49:22.301 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:22.694 INFO 77632 --- [pool-ocp-async-3,4dcbccaa46bb4a1a,8abaaa1b134b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:22.711 WARN 77632 --- [pool-scanner-12300-1,4dcbccaa46bb4a1a,275c4df97fa1] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:22.841 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 393, createErrorCount 18 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 393, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:22.841 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:22.857 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:22.858 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 410, createErrorCount 18 2024-06-04 10:49:22.858 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 410, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:22.879 INFO 77632 --- [pool-ocp-async-5,b09e1e9cbadf4dab,2a99c9afdb06] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:22.909 INFO 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717470000, interval=3600 2024-06-04 10:49:22.913 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:22.913 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 466, createErrorCount 18 2024-06-04 10:49:22.913 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:22.938 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:22.994 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:22.994 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 547, createErrorCount 18 2024-06-04 10:49:22.994 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:23.017 INFO 77632 --- [pool-ocp-async-6,839a892f84154c5d,ad35fc621000] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:23.017 WARN 77632 --- [pool-ocp-async-7,c00393f1f1584745,57e914c983c4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:23.017 WARN 77632 --- [pool-ocp-async-2,05b11f92db9f4068,270e617a042a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.018 ERROR 77632 --- [pool-ocp-async-2,05b11f92db9f4068,270e617a042a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 570, createErrorCount 18 2024-06-04 10:49:23.018 WARN 77632 --- [pool-ocp-async-8,b8212fc801e74c4b,a14fe672498a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:23.018 WARN 77632 --- [pool-ocp-async-10,7440975bf17d432a,33944311a684] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.018 ERROR 77632 --- [pool-ocp-async-10,7440975bf17d432a,33944311a684] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 571, createErrorCount 18 2024-06-04 10:49:23.020 WARN 77632 --- [pool-ocp-async-9,5a9b3adff2554998,5f9149a6eb22] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:23.028 WARN 77632 --- [pool-ocp-async-6,839a892f84154c5d,ad35fc621000] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:23.034 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.034 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 587, createErrorCount 18 2024-06-04 10:49:23.035 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyLogAlarmTarget(ObproxyAlarmTargetProvider.java:90) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 587, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:23.126 ERROR 77632 --- [pool-metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 707, createErrorCount 12 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:699) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1042) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1096) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:74) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:54) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:153) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:144) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 707, createErrorCount 12 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:23.152 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.152 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 705, createErrorCount 18 2024-06-04 10:49:23.152 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:23.281 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.281 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 834, createErrorCount 18 2024-06-04 10:49:23.282 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 834, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:23.470 WARN 77632 --- [pool-ocp-schedules-9,5cd546a719f140c9,dcb4af887b8c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:23.741 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.741 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1294, createErrorCount 18 2024-06-04 10:49:23.741 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1294, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:23.808 WARN 77632 --- [pool-ocp-schedules-6,22a67ed964e54bfe,f802a08e66b0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:23.903 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:23.903 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1456, createErrorCount 18 2024-06-04 10:49:23.903 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1456, createErrorCount 18 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:23.919 WARN 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.301 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1854, createErrorCount 18 2024-06-04 10:49:24.305 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.421 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:24.449 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:24.687 WARN 77632 --- [pool-ocp-schedules-14,eca8fd99a31c478c,7d51a79818f1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.687 WARN 77632 --- [pool-ocp-schedules-17,ea87114983e04e9e,c54f9963ed9b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.689 WARN 77632 --- [pool-ocp-schedules-5,f8bfcfcda6fb48c6,dc06fd28d302] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.690 WARN 77632 --- [pool-ocp-schedules-13,294dfe24d18b4181,2d6a79e5d203] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.690 WARN 77632 --- [pool-ocp-schedules-12,9d03a39633934857,2cef9ec67cbc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.691 WARN 77632 --- [pool-ocp-schedules-8,690fa04ca0164a92,67e3e1bb27ad] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.692 WARN 77632 --- [pool-ocp-schedules-11,fcda44dd34a64054,a3496aa8f2d2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.692 WARN 77632 --- [pool-ocp-schedules-19,fa815a004df44186,7310b983009d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.695 WARN 77632 --- [alarm-detect-29,4dcbccaa46bb4a1a,e4f3fbdd6bf4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-19,4dcbccaa46bb4a1a,2692a82f2cc3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-21,4dcbccaa46bb4a1a,a71a5f720ed8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-12,4dcbccaa46bb4a1a,c850fd0e735c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-20,4dcbccaa46bb4a1a,2687364e5a77] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-11,4dcbccaa46bb4a1a,4a6a1d6fb703] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-3,4dcbccaa46bb4a1a,4c992b8f187f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-24,4dcbccaa46bb4a1a,bb4e0431c8e5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-13,4dcbccaa46bb4a1a,5219e5791ce9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-28,4dcbccaa46bb4a1a,f2d6691bf0bf] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-1,4dcbccaa46bb4a1a,ecdf8a102c28] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-10,4dcbccaa46bb4a1a,5985eb393a6d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-9,4dcbccaa46bb4a1a,49216484ae8d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-14,4dcbccaa46bb4a1a,0046004ef3ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.696 WARN 77632 --- [alarm-detect-26,4dcbccaa46bb4a1a,7231f4c0d306] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.697 WARN 77632 --- [alarm-detect-22,4dcbccaa46bb4a1a,c4be14459c89] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.699 WARN 77632 --- [alarm-detect-8,4dcbccaa46bb4a1a,dd0e3ebb7fe7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.699 WARN 77632 --- [alarm-detect-16,4dcbccaa46bb4a1a,b5278632538a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.712 WARN 77632 --- [alarm-detect-2,4dcbccaa46bb4a1a,8b0e90c0d535] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.716 WARN 77632 --- [alarm-detect-17,4dcbccaa46bb4a1a,a33bcf84a4da] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.752 WARN 77632 --- [alarm-detect-7,4dcbccaa46bb4a1a,8076e2b9a6ac] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.753 WARN 77632 --- [alarm-detect-6,4dcbccaa46bb4a1a,9978a0f89338] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.753 WARN 77632 --- [alarm-detect-5,4dcbccaa46bb4a1a,adb376af6d73] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.768 WARN 77632 --- [alarm-detect-27,4dcbccaa46bb4a1a,2b3da2643163] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.769 WARN 77632 --- [alarm-detect-4,4dcbccaa46bb4a1a,03fdf85b4890] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.772 WARN 77632 --- [alarm-detect-18,4dcbccaa46bb4a1a,be7f8c8204e1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.796 WARN 77632 --- [alarm-detect-25,4dcbccaa46bb4a1a,1969af7557d2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.798 WARN 77632 --- [alarm-detect-23,4dcbccaa46bb4a1a,f47387867fab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.800 WARN 77632 --- [alarm-detect-15,4dcbccaa46bb4a1a,49c3a42d3f4d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.809 WARN 77632 --- [alarm-detect-30,4dcbccaa46bb4a1a,cba150175b9d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.860 WARN 77632 --- [pool-overview-container-2,6d8a6c6932be405d,34285abbcd53] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.860 WARN 77632 --- [pool-overview-container-5,f597825bcd1a4fb7,f07e437c28f7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.869 WARN 77632 --- [pool-overview-container-1,2143da4e9e2e4829,098147efa8e0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.870 WARN 77632 --- [pool-overview-container-3,5063e18b89ce45e3,e6db900e32ba] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.874 WARN 77632 --- [pool-overview-container-4,a56fffa409db4e38,e68a3e3272f0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.879 WARN 77632 --- [pool-ocp-async-5,b09e1e9cbadf4dab,2a99c9afdb06] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.884 WARN 77632 --- [pool-overview-container-8,4eeab8e2f171462d,44fa61bea24a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.909 WARN 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:24.938 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 19 2024-06-04 10:49:25.018 WARN 77632 --- [pool-ocp-async-4,e20679e2ba8d4147,3655d636f106] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:25.018 INFO 77632 --- [pool-ocp-async-2,12285f0bd7dc443b,a88687c7a186] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:25.018 WARN 77632 --- [pool-ocp-async-1,c4cd255463dc4dda,6bb11d93277f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:25.018 WARN 77632 --- [pool-ocp-async-7,c00393f1f1584745,57e914c983c4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.018 ERROR 77632 --- [pool-ocp-async-7,c00393f1f1584745,57e914c983c4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 68, createErrorCount 19 2024-06-04 10:49:25.018 WARN 77632 --- [pool-ocp-async-8,b8212fc801e74c4b,a14fe672498a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.018 ERROR 77632 --- [pool-ocp-async-8,b8212fc801e74c4b,a14fe672498a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 68, createErrorCount 19 2024-06-04 10:49:25.020 WARN 77632 --- [pool-ocp-async-9,5a9b3adff2554998,5f9149a6eb22] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.020 ERROR 77632 --- [pool-ocp-async-9,5a9b3adff2554998,5f9149a6eb22] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 70, createErrorCount 19 2024-06-04 10:49:25.035 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:25.471 WARN 77632 --- [pool-ocp-schedules-9,5cd546a719f140c9,dcb4af887b8c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.471 ERROR 77632 --- [pool-ocp-schedules-9,5cd546a719f140c9,dcb4af887b8c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 521, createErrorCount 19 2024-06-04 10:49:25.471 ERROR 77632 --- [pool-ocp-schedules-9,5cd546a719f140c9,dcb4af887b8c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 521, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:25.808 WARN 77632 --- [pool-ocp-schedules-6,22a67ed964e54bfe,f802a08e66b0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.809 ERROR 77632 --- [pool-ocp-schedules-6,22a67ed964e54bfe,f802a08e66b0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 859, createErrorCount 19 2024-06-04 10:49:25.808 WARN 77632 --- [pool-ocp-async-3,4dcbccaa46bb4a1a,8abaaa1b134b] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:49:25.809 WARN 77632 --- [alarm-detect-29,4dcbccaa46bb4a1a,e4f3fbdd6bf4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.809 ERROR 77632 --- [alarm-detect-29,4dcbccaa46bb4a1a,e4f3fbdd6bf4] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.809 WARN 77632 --- [alarm-detect-13,4dcbccaa46bb4a1a,5219e5791ce9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.809 ERROR 77632 --- [alarm-detect-13,4dcbccaa46bb4a1a,5219e5791ce9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.809 ERROR 77632 --- [pool-ocp-schedules-6,22a67ed964e54bfe,f802a08e66b0] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 859, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:25.809 ERROR 77632 --- [alarm-detect-13,4dcbccaa46bb4a1a,5219e5791ce9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_ntp_offset_too_large org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.809 ERROR 77632 --- [alarm-detect-29,4dcbccaa46bb4a1a,e4f3fbdd6bf4] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_mem_hold_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.877 WARN 77632 --- [alarm-detect-1,4dcbccaa46bb4a1a,ecdf8a102c28] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.877 ERROR 77632 --- [alarm-detect-1,4dcbccaa46bb4a1a,ecdf8a102c28] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.878 ERROR 77632 --- [alarm-detect-1,4dcbccaa46bb4a1a,ecdf8a102c28] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=standby_tenant_sync_delay_too_long org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.878 WARN 77632 --- [alarm-detect-22,4dcbccaa46bb4a1a,c4be14459c89] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.878 ERROR 77632 --- [alarm-detect-22,4dcbccaa46bb4a1a,c4be14459c89] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.879 ERROR 77632 --- [alarm-detect-22,4dcbccaa46bb4a1a,c4be14459c89] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_status_check_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.879 WARN 77632 --- [alarm-detect-7,4dcbccaa46bb4a1a,8076e2b9a6ac] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.879 ERROR 77632 --- [alarm-detect-7,4dcbccaa46bb4a1a,8076e2b9a6ac] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.880 ERROR 77632 --- [alarm-detect-7,4dcbccaa46bb4a1a,8076e2b9a6ac] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_merge_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.880 WARN 77632 --- [alarm-detect-27,4dcbccaa46bb4a1a,2b3da2643163] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.880 ERROR 77632 --- [alarm-detect-27,4dcbccaa46bb4a1a,2b3da2643163] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.881 ERROR 77632 --- [alarm-detect-27,4dcbccaa46bb4a1a,2b3da2643163] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=backup_storage_capacity_timeout_or_interrupted org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.881 WARN 77632 --- [alarm-detect-18,4dcbccaa46bb4a1a,be7f8c8204e1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.881 ERROR 77632 --- [alarm-detect-18,4dcbccaa46bb4a1a,be7f8c8204e1] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.881 ERROR 77632 --- [alarm-detect-18,4dcbccaa46bb4a1a,be7f8c8204e1] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_etcd_cannot_connect_to_leader org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.882 WARN 77632 --- [alarm-detect-30,4dcbccaa46bb4a1a,cba150175b9d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.882 ERROR 77632 --- [alarm-detect-30,4dcbccaa46bb4a1a,cba150175b9d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.882 ERROR 77632 --- [alarm-detect-30,4dcbccaa46bb4a1a,cba150175b9d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxyd_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.882 WARN 77632 --- [alarm-detect-2,4dcbccaa46bb4a1a,8b0e90c0d535] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.882 ERROR 77632 --- [alarm-detect-2,4dcbccaa46bb4a1a,8b0e90c0d535] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.883 ERROR 77632 --- [alarm-detect-2,4dcbccaa46bb4a1a,8b0e90c0d535] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=agent_process_count_abnormal org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.884 WARN 77632 --- [alarm-detect-17,4dcbccaa46bb4a1a,a33bcf84a4da] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.884 ERROR 77632 --- [alarm-detect-17,4dcbccaa46bb4a1a,a33bcf84a4da] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.884 ERROR 77632 --- [alarm-detect-17,4dcbccaa46bb4a1a,a33bcf84a4da] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_log_disk_usage_high org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.884 WARN 77632 --- [alarm-detect-15,4dcbccaa46bb4a1a,49c3a42d3f4d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.884 ERROR 77632 --- [alarm-detect-15,4dcbccaa46bb4a1a,49c3a42d3f4d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.885 ERROR 77632 --- [alarm-detect-15,4dcbccaa46bb4a1a,49c3a42d3f4d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.885 WARN 77632 --- [alarm-detect-4,4dcbccaa46bb4a1a,03fdf85b4890] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.885 ERROR 77632 --- [alarm-detect-4,4dcbccaa46bb4a1a,03fdf85b4890] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.886 ERROR 77632 --- [alarm-detect-4,4dcbccaa46bb4a1a,03fdf85b4890] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_net_recv_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.886 WARN 77632 --- [alarm-detect-25,4dcbccaa46bb4a1a,1969af7557d2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.886 ERROR 77632 --- [alarm-detect-25,4dcbccaa46bb4a1a,1969af7557d2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.886 ERROR 77632 --- [alarm-detect-25,4dcbccaa46bb4a1a,1969af7557d2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_collect_metric_failure_rate_high org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.887 WARN 77632 --- [alarm-detect-16,4dcbccaa46bb4a1a,b5278632538a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.887 ERROR 77632 --- [alarm-detect-16,4dcbccaa46bb4a1a,b5278632538a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.887 ERROR 77632 --- [alarm-detect-16,4dcbccaa46bb4a1a,b5278632538a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_no_compaction org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.887 WARN 77632 --- [alarm-detect-21,4dcbccaa46bb4a1a,a71a5f720ed8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.887 ERROR 77632 --- [alarm-detect-21,4dcbccaa46bb4a1a,a71a5f720ed8] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.888 ERROR 77632 --- [alarm-detect-21,4dcbccaa46bb4a1a,a71a5f720ed8] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=agentd_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.888 WARN 77632 --- [alarm-detect-12,4dcbccaa46bb4a1a,c850fd0e735c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.888 ERROR 77632 --- [alarm-detect-12,4dcbccaa46bb4a1a,c850fd0e735c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.888 WARN 77632 --- [alarm-detect-20,4dcbccaa46bb4a1a,2687364e5a77] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.888 ERROR 77632 --- [alarm-detect-20,4dcbccaa46bb4a1a,2687364e5a77] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.889 ERROR 77632 --- [alarm-detect-20,4dcbccaa46bb4a1a,2687364e5a77] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_overload org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.889 WARN 77632 --- [alarm-detect-8,4dcbccaa46bb4a1a,dd0e3ebb7fe7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.889 ERROR 77632 --- [alarm-detect-8,4dcbccaa46bb4a1a,dd0e3ebb7fe7] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.890 WARN 77632 --- [alarm-detect-11,4dcbccaa46bb4a1a,4a6a1d6fb703] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.890 ERROR 77632 --- [alarm-detect-11,4dcbccaa46bb4a1a,4a6a1d6fb703] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.891 ERROR 77632 --- [alarm-detect-11,4dcbccaa46bb4a1a,4a6a1d6fb703] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_mem_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.891 WARN 77632 --- [alarm-detect-3,4dcbccaa46bb4a1a,4c992b8f187f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.891 ERROR 77632 --- [alarm-detect-3,4dcbccaa46bb4a1a,4c992b8f187f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.892 ERROR 77632 --- [alarm-detect-3,4dcbccaa46bb4a1a,4c992b8f187f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=observer_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.892 WARN 77632 --- [alarm-detect-24,4dcbccaa46bb4a1a,bb4e0431c8e5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.892 ERROR 77632 --- [alarm-detect-24,4dcbccaa46bb4a1a,bb4e0431c8e5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.892 ERROR 77632 --- [alarm-detect-24,4dcbccaa46bb4a1a,bb4e0431c8e5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_stopped org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.893 WARN 77632 --- [alarm-detect-10,4dcbccaa46bb4a1a,5985eb393a6d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.893 ERROR 77632 --- [alarm-detect-10,4dcbccaa46bb4a1a,5985eb393a6d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.893 ERROR 77632 --- [alarm-detect-10,4dcbccaa46bb4a1a,5985eb393a6d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_expired_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.893 WARN 77632 --- [alarm-detect-9,4dcbccaa46bb4a1a,49216484ae8d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.893 ERROR 77632 --- [alarm-detect-9,4dcbccaa46bb4a1a,49216484ae8d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.902 ERROR 77632 --- [alarm-detect-12,4dcbccaa46bb4a1a,c850fd0e735c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_no_merge org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.902 ERROR 77632 --- [alarm-detect-8,4dcbccaa46bb4a1a,dd0e3ebb7fe7] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_connection_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.894 ERROR 77632 --- [alarm-detect-9,4dcbccaa46bb4a1a,49216484ae8d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_large_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.905 WARN 77632 --- [alarm-detect-14,4dcbccaa46bb4a1a,0046004ef3ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.905 ERROR 77632 --- [alarm-detect-14,4dcbccaa46bb4a1a,0046004ef3ab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.906 ERROR 77632 --- [alarm-detect-14,4dcbccaa46bb4a1a,0046004ef3ab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_storage_short_meta_mem_hold_high org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.906 WARN 77632 --- [alarm-detect-26,4dcbccaa46bb4a1a,7231f4c0d306] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.906 ERROR 77632 --- [alarm-detect-26,4dcbccaa46bb4a1a,7231f4c0d306] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.907 ERROR 77632 --- [alarm-detect-26,4dcbccaa46bb4a1a,7231f4c0d306] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_full org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.907 WARN 77632 --- [alarm-detect-6,4dcbccaa46bb4a1a,9978a0f89338] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.907 ERROR 77632 --- [alarm-detect-6,4dcbccaa46bb4a1a,9978a0f89338] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.908 ERROR 77632 --- [alarm-detect-6,4dcbccaa46bb4a1a,9978a0f89338] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_observer_not_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.908 WARN 77632 --- [alarm-detect-5,4dcbccaa46bb4a1a,adb376af6d73] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.908 ERROR 77632 --- [alarm-detect-5,4dcbccaa46bb4a1a,adb376af6d73] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.909 ERROR 77632 --- [alarm-detect-5,4dcbccaa46bb4a1a,adb376af6d73] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_agent_open_fd_count_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.909 WARN 77632 --- [alarm-detect-23,4dcbccaa46bb4a1a,f47387867fab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.909 ERROR 77632 --- [alarm-detect-23,4dcbccaa46bb4a1a,f47387867fab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.910 ERROR 77632 --- [alarm-detect-23,4dcbccaa46bb4a1a,f47387867fab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_etcd_leader_switched org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.912 WARN 77632 --- [alarm-detect-19,4dcbccaa46bb4a1a,2692a82f2cc3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.912 ERROR 77632 --- [alarm-detect-19,4dcbccaa46bb4a1a,2692a82f2cc3] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.912 ERROR 77632 --- [alarm-detect-19,4dcbccaa46bb4a1a,2692a82f2cc3] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_exists_expired_xa_trans org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.913 WARN 77632 --- [alarm-detect-28,4dcbccaa46bb4a1a,f2d6691bf0bf] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.913 ERROR 77632 --- [alarm-detect-28,4dcbccaa46bb4a1a,f2d6691bf0bf] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:25.913 ERROR 77632 --- [alarm-detect-28,4dcbccaa46bb4a1a,f2d6691bf0bf] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=node_file_inode_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:25.924 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:25.924 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:25.924 WARN 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:25.924 ERROR 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 974, createErrorCount 19 2024-06-04 10:49:25.924 ERROR 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 974, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:25.924 INFO 77632 --- [pool-prometheus-minute-schedule-1,a4b28857ea924347,3e20317eebf7] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469361919, count=0, elapsed=4005 2024-06-04 10:49:25.924 INFO 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:25.994 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.152 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.282 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.305 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.305 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1355, createErrorCount 19 2024-06-04 10:49:26.307 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [POST /services client=0:0:0:0:0:0:0:1, traceId=f8f8baba11c94d84, args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469360287260,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},, duration=4017 ms] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1355, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.311 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-10,f8f8baba11c94d84,fceea9993f33] c.o.o.s.c.exception.RpcExceptionHandler : Unhandled exception, uri=/services, duration=4022 org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1355, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.687 WARN 77632 --- [pool-ocp-schedules-14,eca8fd99a31c478c,7d51a79818f1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.688 ERROR 77632 --- [pool-ocp-schedules-14,eca8fd99a31c478c,7d51a79818f1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1738, createErrorCount 19 2024-06-04 10:49:26.688 WARN 77632 --- [pool-ocp-schedules-17,ea87114983e04e9e,c54f9963ed9b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.688 ERROR 77632 --- [pool-ocp-schedules-17,ea87114983e04e9e,c54f9963ed9b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1738, createErrorCount 19 2024-06-04 10:49:26.688 ERROR 77632 --- [pool-ocp-schedules-17,ea87114983e04e9e,c54f9963ed9b] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1738, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.688 ERROR 77632 --- [pool-ocp-schedules-14,eca8fd99a31c478c,7d51a79818f1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1738, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.689 WARN 77632 --- [pool-ocp-schedules-5,f8bfcfcda6fb48c6,dc06fd28d302] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.689 ERROR 77632 --- [pool-ocp-schedules-5,f8bfcfcda6fb48c6,dc06fd28d302] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1739, createErrorCount 19 2024-06-04 10:49:26.690 ERROR 77632 --- [pool-ocp-schedules-5,f8bfcfcda6fb48c6,dc06fd28d302] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1739, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.690 WARN 77632 --- [pool-ocp-schedules-12,9d03a39633934857,2cef9ec67cbc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.690 WARN 77632 --- [pool-ocp-schedules-13,294dfe24d18b4181,2d6a79e5d203] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.690 ERROR 77632 --- [pool-ocp-schedules-13,294dfe24d18b4181,2d6a79e5d203] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1741, createErrorCount 19 2024-06-04 10:49:26.690 ERROR 77632 --- [pool-ocp-schedules-12,9d03a39633934857,2cef9ec67cbc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1741, createErrorCount 19 2024-06-04 10:49:26.691 ERROR 77632 --- [pool-ocp-schedules-13,294dfe24d18b4181,2d6a79e5d203] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1741, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.691 ERROR 77632 --- [pool-ocp-schedules-12,9d03a39633934857,2cef9ec67cbc] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1741, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.691 WARN 77632 --- [pool-ocp-schedules-8,690fa04ca0164a92,67e3e1bb27ad] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.691 ERROR 77632 --- [pool-ocp-schedules-8,690fa04ca0164a92,67e3e1bb27ad] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 2024-06-04 10:49:26.692 ERROR 77632 --- [pool-ocp-schedules-8,690fa04ca0164a92,67e3e1bb27ad] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.692 WARN 77632 --- [pool-ocp-schedules-11,fcda44dd34a64054,a3496aa8f2d2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.692 ERROR 77632 --- [pool-ocp-schedules-11,fcda44dd34a64054,a3496aa8f2d2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 2024-06-04 10:49:26.692 WARN 77632 --- [pool-ocp-schedules-19,fa815a004df44186,7310b983009d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.692 ERROR 77632 --- [pool-ocp-schedules-19,fa815a004df44186,7310b983009d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 2024-06-04 10:49:26.692 ERROR 77632 --- [pool-ocp-schedules-11,fcda44dd34a64054,a3496aa8f2d2] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.692 ERROR 77632 --- [pool-ocp-schedules-19,fa815a004df44186,7310b983009d] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1742, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.695 WARN 77632 --- [pool-ocp-schedules-2,8d57a85f003a4ac6,25c43bc586e7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.742 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.860 WARN 77632 --- [pool-overview-container-2,6d8a6c6932be405d,34285abbcd53] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.860 ERROR 77632 --- [pool-overview-container-2,6d8a6c6932be405d,34285abbcd53] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 19 2024-06-04 10:49:26.861 ERROR 77632 --- [pool-overview-container-2,6d8a6c6932be405d,34285abbcd53] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.861 WARN 77632 --- [pool-overview-container-2,6d8a6c6932be405d,34285abbcd53] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.861 WARN 77632 --- [pool-overview-container-5,f597825bcd1a4fb7,f07e437c28f7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.862 ERROR 77632 --- [pool-overview-container-5,f597825bcd1a4fb7,f07e437c28f7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1912, createErrorCount 19 2024-06-04 10:49:26.862 ERROR 77632 --- [pool-overview-container-5,f597825bcd1a4fb7,f07e437c28f7] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1912, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.865 WARN 77632 --- [pool-overview-container-5,f597825bcd1a4fb7,f07e437c28f7] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1912, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.870 WARN 77632 --- [pool-overview-container-3,5063e18b89ce45e3,e6db900e32ba] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.870 ERROR 77632 --- [pool-overview-container-3,5063e18b89ce45e3,e6db900e32ba] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 19 2024-06-04 10:49:26.870 ERROR 77632 --- [pool-overview-container-3,5063e18b89ce45e3,e6db900e32ba] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.871 WARN 77632 --- [pool-overview-container-1,2143da4e9e2e4829,098147efa8e0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.871 ERROR 77632 --- [pool-overview-container-1,2143da4e9e2e4829,098147efa8e0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1921, createErrorCount 19 2024-06-04 10:49:26.871 WARN 77632 --- [pool-overview-container-3,5063e18b89ce45e3,e6db900e32ba] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.871 ERROR 77632 --- [pool-overview-container-1,2143da4e9e2e4829,098147efa8e0] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1921, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.871 WARN 77632 --- [pool-overview-container-1,2143da4e9e2e4829,098147efa8e0] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1921, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.874 WARN 77632 --- [pool-overview-container-4,a56fffa409db4e38,e68a3e3272f0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.875 ERROR 77632 --- [pool-overview-container-4,a56fffa409db4e38,e68a3e3272f0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1925, createErrorCount 19 2024-06-04 10:49:26.875 ERROR 77632 --- [pool-overview-container-4,a56fffa409db4e38,e68a3e3272f0] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1925, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.875 WARN 77632 --- [pool-overview-container-4,a56fffa409db4e38,e68a3e3272f0] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1925, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.879 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.880 WARN 77632 --- [pool-ocp-async-5,b09e1e9cbadf4dab,2a99c9afdb06] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.880 ERROR 77632 --- [pool-ocp-async-5,b09e1e9cbadf4dab,2a99c9afdb06] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1930, createErrorCount 19 2024-06-04 10:49:26.884 WARN 77632 --- [pool-overview-container-8,4eeab8e2f171462d,44fa61bea24a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.884 ERROR 77632 --- [pool-overview-container-8,4eeab8e2f171462d,44fa61bea24a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 19 2024-06-04 10:49:26.884 ERROR 77632 --- [pool-overview-container-8,4eeab8e2f171462d,44fa61bea24a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.884 WARN 77632 --- [pool-overview-container-8,4eeab8e2f171462d,44fa61bea24a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1934, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.909 WARN 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:26.909 ERROR 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1959, createErrorCount 19 2024-06-04 10:49:26.910 ERROR 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$1(OcpMonitorManager.java:135) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1959, createErrorCount 19 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.910 INFO 77632 --- [pool-prometheus-hour-schedule-1,58f6357d35ba4bdb,4491b66ac1dd] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469362909, count=0, elapsed=4001 2024-06-04 10:49:26.924 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:26.939 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:26.952 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:27.018 WARN 77632 --- [pool-ocp-async-6,a99bc50a105743aa,111e9a2a8c45] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.018 WARN 77632 --- [pool-ocp-async-10,4a9f1d9d816f405b,c9d039891b7c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.018 WARN 77632 --- [pool-ocp-async-4,e20679e2ba8d4147,3655d636f106] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.018 INFO 77632 --- [pool-ocp-async-5,c8c096204d3b4b7c,cf68294da67a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:27.018 ERROR 77632 --- [pool-ocp-async-4,e20679e2ba8d4147,3655d636f106] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 20 2024-06-04 10:49:27.018 WARN 77632 --- [pool-ocp-async-1,c4cd255463dc4dda,6bb11d93277f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.018 ERROR 77632 --- [pool-ocp-async-1,c4cd255463dc4dda,6bb11d93277f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 20 2024-06-04 10:49:27.020 WARN 77632 --- [pool-ocp-async-2,12285f0bd7dc443b,a88687c7a186] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.028 WARN 77632 --- [pool-ocp-async-5,c8c096204d3b4b7c,cf68294da67a] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:27.036 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.036 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 20 2024-06-04 10:49:27.036 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:334) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildOcpHostAlarmTarget(OcpHostAlarmTargetProvider.java:69) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 42 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 46 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:27.272 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.317 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.797 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-8,bff35496973049b5,e68b206e78ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.916 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.916 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.924 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.924 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 469, createErrorCount 20 2024-06-04 10:49:27.924 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.924 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 469, createErrorCount 20 2024-06-04 10:49:27.924 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:27.925 WARN 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:27.925 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 469, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:27.994 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:27.994 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 539, createErrorCount 20 2024-06-04 10:49:27.995 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:28.152 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:28.152 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 697, createErrorCount 20 2024-06-04 10:49:28.152 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:28.283 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:28.283 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 827, createErrorCount 20 2024-06-04 10:49:28.283 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 827, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:28.696 WARN 77632 --- [pool-ocp-schedules-2,8d57a85f003a4ac6,25c43bc586e7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:28.696 ERROR 77632 --- [pool-ocp-schedules-2,8d57a85f003a4ac6,25c43bc586e7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1240, createErrorCount 20 2024-06-04 10:49:28.696 ERROR 77632 --- [pool-ocp-schedules-2,8d57a85f003a4ac6,25c43bc586e7] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1240, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:28.734 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:28.742 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:28.742 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1287, createErrorCount 20 2024-06-04 10:49:28.742 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1287, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:28.879 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:28.879 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1424, createErrorCount 20 2024-06-04 10:49:28.880 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1424, createErrorCount 20 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:28.904 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:28.939 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1484, createErrorCount 20 2024-06-04 10:49:29.018 WARN 77632 --- [pool-ocp-async-10,4a9f1d9d816f405b,c9d039891b7c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.018 WARN 77632 --- [pool-ocp-async-9,43295073288c40a3,ca7e804c5b4d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:29.018 ERROR 77632 --- [pool-ocp-async-10,4a9f1d9d816f405b,c9d039891b7c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1563, createErrorCount 20 2024-06-04 10:49:29.018 WARN 77632 --- [pool-ocp-async-7,66cc724cb43a4b54,8e8f4ff0051f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:29.018 WARN 77632 --- [pool-ocp-async-6,a99bc50a105743aa,111e9a2a8c45] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.018 ERROR 77632 --- [pool-ocp-async-6,a99bc50a105743aa,111e9a2a8c45] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1563, createErrorCount 20 2024-06-04 10:49:29.018 INFO 77632 --- [pool-ocp-async-3,ae474c2012c248f8,608101f7bf4b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:29.020 WARN 77632 --- [pool-ocp-async-2,12285f0bd7dc443b,a88687c7a186] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.020 ERROR 77632 --- [pool-ocp-async-2,12285f0bd7dc443b,a88687c7a186] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1565, createErrorCount 20 2024-06-04 10:49:29.036 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:29.244 WARN 77632 --- [pool-ocp-schedules-5,e457888e31144da1,0fc01a2de87b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:29.272 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.272 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1817, createErrorCount 20 2024-06-04 10:49:29.272 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:29.317 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.317 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1862, createErrorCount 20 2024-06-04 10:49:29.317 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:29.427 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.457 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.797 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-8,bff35496973049b5,e68b206e78ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.797 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-8,bff35496973049b5,e68b206e78ab] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 2024-06-04 10:49:29.800 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.security.web.context.HttpSessionSecurityContextRepository.loadContext(HttpSessionSecurityContextRepository.java:118) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:100) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 64 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 71 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.917 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.917 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 2024-06-04 10:49:29.917 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.917 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:29.917 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.925 WARN 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:29.925 ERROR 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 2024-06-04 10:49:29.925 ERROR 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:29.925 INFO 77632 --- [pool-prometheus-minute-schedule-1,34654c847cc94e66,2c68c262ca88] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469365924, count=0, elapsed=4001 2024-06-04 10:49:29.925 INFO 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:30.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:49:30.671 INFO 77632 --- [pool-print-time-series-interval15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469370: {1717469220=57, 1717469235=57, 1717469250=57, 1717469265=57, 1717469280=57, 1717469295=57, 1717469310=57, 1717469325=8}, tsDataMapSize: 57032, readyDataCacheSize: 35032 2024-06-04 10:49:30.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:49:30.716 INFO 77632 --- [pool-print-time-series-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469370: {}, tsDataMapSize: 80, readyDataCacheSize: 64 2024-06-04 10:49:30.734 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:30.734 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 776, createErrorCount 21 2024-06-04 10:49:30.734 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:30.904 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:30.904 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 946, createErrorCount 21 2024-06-04 10:49:30.905 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 946, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:30.925 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:30.939 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:30.995 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.018 INFO 77632 --- [pool-ocp-async-5,0dc0ea0f4e6b4e6c,e208b049f31c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:31.018 WARN 77632 --- [pool-ocp-async-9,43295073288c40a3,ca7e804c5b4d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:31.018 ERROR 77632 --- [pool-ocp-async-9,43295073288c40a3,ca7e804c5b4d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1060, createErrorCount 21 2024-06-04 10:49:31.018 WARN 77632 --- [pool-ocp-async-7,66cc724cb43a4b54,8e8f4ff0051f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:31.018 WARN 77632 --- [pool-ocp-async-10,7526dec4f923413c,7702deee04b7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.018 ERROR 77632 --- [pool-ocp-async-7,66cc724cb43a4b54,8e8f4ff0051f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1060, createErrorCount 21 2024-06-04 10:49:31.018 WARN 77632 --- [pool-ocp-async-8,3e289910c8374ea6,df1463b3b100] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.021 WARN 77632 --- [pool-ocp-async-3,ae474c2012c248f8,608101f7bf4b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.029 WARN 77632 --- [pool-ocp-async-5,0dc0ea0f4e6b4e6c,e208b049f31c] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:31.037 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:31.037 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1079, createErrorCount 21 2024-06-04 10:49:31.037 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:334) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildHostLogAlarmTarget(OcpHostAlarmTargetProvider.java:75) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 42 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1079, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 46 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:31.109 INFO 77632 --- [pool-metric-parse-8,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469370, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:49:31.153 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.245 WARN 77632 --- [pool-ocp-schedules-5,e457888e31144da1,0fc01a2de87b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:31.245 ERROR 77632 --- [pool-ocp-schedules-5,e457888e31144da1,0fc01a2de87b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1286, createErrorCount 21 2024-06-04 10:49:31.245 ERROR 77632 --- [pool-ocp-schedules-5,e457888e31144da1,0fc01a2de87b] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at collect-obproxy-metrics at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.lockAndExec(ObproxySchedules.java:34) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.collectObproxyMetrics(ObproxySchedules.java:29) at sun.reflect.GeneratedMethodAccessor502.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1286, createErrorCount 21 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:31.283 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.743 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.813 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.925 WARN 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:31.930 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:31.960 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:32.694 INFO 77632 --- [pool-ocp-async-9,cbe12cb0587d48c5,b998c4507b0f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:32.716 WARN 77632 --- [pool-scanner-12324-1,cbe12cb0587d48c5,90054c87c75b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:32.875 INFO 77632 --- [pool-ocp-async-5,389bb5bbda1d462e,d4d3b976b112] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:32.925 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:32.925 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 464, createErrorCount 22 2024-06-04 10:49:32.925 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:32.925 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:32.939 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 478, createErrorCount 22 2024-06-04 10:49:32.995 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:32.995 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 534, createErrorCount 22 2024-06-04 10:49:32.995 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:33.018 WARN 77632 --- [pool-ocp-async-2,c519ac0a3f8b4294,2613ad47f448] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:33.018 WARN 77632 --- [pool-ocp-async-1,d760a1e207b740d9,a00bf60273f8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:33.018 INFO 77632 --- [pool-ocp-async-6,a839bcb034e948d4,908a3ef69429] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:33.018 WARN 77632 --- [pool-ocp-async-8,3e289910c8374ea6,df1463b3b100] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.019 ERROR 77632 --- [pool-ocp-async-8,3e289910c8374ea6,df1463b3b100] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 558, createErrorCount 22 2024-06-04 10:49:33.019 WARN 77632 --- [pool-ocp-async-10,7526dec4f923413c,7702deee04b7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.019 ERROR 77632 --- [pool-ocp-async-10,7526dec4f923413c,7702deee04b7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 558, createErrorCount 22 2024-06-04 10:49:33.021 WARN 77632 --- [pool-ocp-async-3,ae474c2012c248f8,608101f7bf4b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.021 ERROR 77632 --- [pool-ocp-async-3,ae474c2012c248f8,608101f7bf4b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 560, createErrorCount 22 2024-06-04 10:49:33.038 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:33.153 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.153 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 692, createErrorCount 22 2024-06-04 10:49:33.153 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:33.283 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.284 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 822, createErrorCount 22 2024-06-04 10:49:33.284 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 822, createErrorCount 22 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:33.743 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.743 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1282, createErrorCount 22 2024-06-04 10:49:33.743 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1282, createErrorCount 22 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:33.814 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.814 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1353, createErrorCount 22 2024-06-04 10:49:33.815 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] threw exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.security.web.savedrequest.HttpSessionRequestCache.getRequest(HttpSessionRequestCache.java:85) at org.springframework.security.web.savedrequest.HttpSessionRequestCache.getMatchingRequest(HttpSessionRequestCache.java:100) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:61) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:89) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294) at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373) at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237) at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 72 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1353, createErrorCount 22 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 79 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:33.816 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-8,,] o.a.c.c.C.[Tomcat].[localhost] : Exception Processing ErrorPage[errorCode=0, location=/error] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.security.web.savedrequest.HttpSessionRequestCache.getRequest(HttpSessionRequestCache.java:85) at org.springframework.security.web.savedrequest.HttpSessionRequestCache.getMatchingRequest(HttpSessionRequestCache.java:100) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:61) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:89) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294) at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373) at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237) at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 72 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1353, createErrorCount 22 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 79 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:33.880 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:33.926 WARN 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:33.926 ERROR 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1465, createErrorCount 22 2024-06-04 10:49:33.926 ERROR 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1465, createErrorCount 22 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:33.926 INFO 77632 --- [pool-prometheus-minute-schedule-1,ffaa7a7e02ac4f8b,409418ae7c3e] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469369925, count=0, elapsed=4001 2024-06-04 10:49:33.926 INFO 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:34.433 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:34.463 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:34.705 WARN 77632 --- [alarm-detect-18,cbe12cb0587d48c5,768edcada1e6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.705 WARN 77632 --- [alarm-detect-30,cbe12cb0587d48c5,9973e9241eaf] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.705 WARN 77632 --- [alarm-detect-2,cbe12cb0587d48c5,a242c9659042] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-17,cbe12cb0587d48c5,339bd744f12c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-15,cbe12cb0587d48c5,75537550e431] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-4,cbe12cb0587d48c5,e7686a87e271] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-20,cbe12cb0587d48c5,b4f43d0f2140] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-11,cbe12cb0587d48c5,3891ad5ccbeb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.706 WARN 77632 --- [alarm-detect-3,cbe12cb0587d48c5,f4f76a56a076] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.707 WARN 77632 --- [alarm-detect-24,cbe12cb0587d48c5,17dd2bdc7b50] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.707 WARN 77632 --- [alarm-detect-10,cbe12cb0587d48c5,d648bc756e34] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.707 WARN 77632 --- [alarm-detect-9,cbe12cb0587d48c5,51e53ab0caef] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.708 WARN 77632 --- [alarm-detect-14,cbe12cb0587d48c5,0d9957650a2c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.708 WARN 77632 --- [alarm-detect-6,cbe12cb0587d48c5,60a4cac5e0c3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.708 WARN 77632 --- [alarm-detect-23,cbe12cb0587d48c5,6c96056a097f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.709 WARN 77632 --- [alarm-detect-19,cbe12cb0587d48c5,3aac37dae86d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.709 WARN 77632 --- [alarm-detect-28,cbe12cb0587d48c5,543fbd29e0e6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.742 WARN 77632 --- [alarm-detect-29,cbe12cb0587d48c5,8bb936112cd0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.755 WARN 77632 --- [alarm-detect-5,cbe12cb0587d48c5,d8e9e5ea88b4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.767 WARN 77632 --- [alarm-detect-13,cbe12cb0587d48c5,154ddcb972d9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.787 WARN 77632 --- [alarm-detect-8,cbe12cb0587d48c5,e6f2194730da] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.787 WARN 77632 --- [alarm-detect-12,cbe12cb0587d48c5,851b0f3ded42] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.802 WARN 77632 --- [alarm-detect-16,cbe12cb0587d48c5,3dbc23bcdbcb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.803 WARN 77632 --- [alarm-detect-25,cbe12cb0587d48c5,9690caae761e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.818 WARN 77632 --- [alarm-detect-21,cbe12cb0587d48c5,c84a3470991c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.818 WARN 77632 --- [alarm-detect-7,cbe12cb0587d48c5,302d977b5225] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.829 WARN 77632 --- [alarm-detect-27,cbe12cb0587d48c5,28724a7ccf47] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.860 WARN 77632 --- [pool-overview-container-6,bc3a8f61497e4832,139a52d70c37] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.864 WARN 77632 --- [pool-overview-container-2,70aa437300564c64,bc2b09757a6f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.864 WARN 77632 --- [pool-overview-container-7,a6117ca0bd9e44bc,9f400b64888e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.864 WARN 77632 --- [pool-overview-container-5,0027bd778fc0454b,4bfe6045902a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.865 WARN 77632 --- [alarm-detect-1,cbe12cb0587d48c5,f31392fc732d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.866 WARN 77632 --- [alarm-detect-26,cbe12cb0587d48c5,671eb854cd03] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.867 WARN 77632 --- [alarm-detect-22,cbe12cb0587d48c5,a14939894527] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.874 WARN 77632 --- [pool-overview-container-3,e0e644937eb44559,552db9320359] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.875 WARN 77632 --- [pool-ocp-async-5,389bb5bbda1d462e,d4d3b976b112] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.884 WARN 77632 --- [pool-overview-container-1,dd38bbd363be439f,6120c2debc56] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.917 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.918 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:34.925 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:34.926 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 23 2024-06-04 10:49:34.926 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:34.940 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.018 INFO 77632 --- [pool-ocp-async-10,8c2dee19e3524dfd,935f44949223] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:35.018 WARN 77632 --- [pool-ocp-async-2,c519ac0a3f8b4294,2613ad47f448] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.018 ERROR 77632 --- [pool-ocp-async-2,c519ac0a3f8b4294,2613ad47f448] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 55, createErrorCount 23 2024-06-04 10:49:35.019 WARN 77632 --- [pool-ocp-async-7,e96713f469ee47ca,2dbf62446315] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.019 WARN 77632 --- [pool-ocp-async-1,d760a1e207b740d9,a00bf60273f8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.019 ERROR 77632 --- [pool-ocp-async-1,d760a1e207b740d9,a00bf60273f8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 55, createErrorCount 23 2024-06-04 10:49:35.019 WARN 77632 --- [pool-ocp-async-4,e2e91daea2974965,4a3a0b2b9309] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.021 WARN 77632 --- [pool-ocp-async-6,a839bcb034e948d4,908a3ef69429] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.028 WARN 77632 --- [pool-ocp-async-10,8c2dee19e3524dfd,935f44949223] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:35.038 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.038 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 74, createErrorCount 23 2024-06-04 10:49:35.041 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy319.findIdByServiceTypes(Unknown Source) at com.oceanbase.ocp.service.compute.HostDaoManager.serviceTypeIn(HostDaoManager.java:282) at com.oceanbase.ocp.service.compute.HostDaoManager.findByStatusAndKeywordAndServiceType(HostDaoManager.java:202) at com.oceanbase.ocp.service.compute.HostDaoManager.findAll(HostDaoManager.java:89) at com.oceanbase.ocp.service.compute.HostDaoManager$$FastClassBySpringCGLIB$$6c2f5d71.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.compute.HostDaoManager$$EnhancerBySpringCGLIB$$218520c4.findAll() at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:286) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildBackupHostAlarmTarget(OcpHostAlarmTargetProvider.java:80) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 44 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 74, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 86 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:35.809 INFO 77632 --- [pool-ocp-schedules-2,00c8297cc4f64d68,932e37370b44] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:49:35.864 WARN 77632 --- [pool-ocp-async-9,cbe12cb0587d48c5,b998c4507b0f] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:49:35.865 WARN 77632 --- [alarm-detect-18,cbe12cb0587d48c5,768edcada1e6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.865 ERROR 77632 --- [alarm-detect-18,cbe12cb0587d48c5,768edcada1e6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.865 WARN 77632 --- [alarm-detect-2,cbe12cb0587d48c5,a242c9659042] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.865 ERROR 77632 --- [alarm-detect-2,cbe12cb0587d48c5,a242c9659042] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.865 ERROR 77632 --- [alarm-detect-2,cbe12cb0587d48c5,a242c9659042] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_nic_1000m_full org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.866 ERROR 77632 --- [alarm-detect-18,cbe12cb0587d48c5,768edcada1e6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=monagent_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.866 WARN 77632 --- [alarm-detect-17,cbe12cb0587d48c5,339bd744f12c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.866 ERROR 77632 --- [alarm-detect-17,cbe12cb0587d48c5,339bd744f12c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.867 ERROR 77632 --- [alarm-detect-17,cbe12cb0587d48c5,339bd744f12c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_monitordb_disconnected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.867 WARN 77632 --- [alarm-detect-15,cbe12cb0587d48c5,75537550e431] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.867 ERROR 77632 --- [alarm-detect-15,cbe12cb0587d48c5,75537550e431] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.867 ERROR 77632 --- [alarm-detect-15,cbe12cb0587d48c5,75537550e431] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxyd_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.868 WARN 77632 --- [alarm-detect-4,cbe12cb0587d48c5,e7686a87e271] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.868 ERROR 77632 --- [alarm-detect-4,cbe12cb0587d48c5,e7686a87e271] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.868 ERROR 77632 --- [alarm-detect-4,cbe12cb0587d48c5,e7686a87e271] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_mem_hold_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.868 WARN 77632 --- [alarm-detect-25,cbe12cb0587d48c5,9690caae761e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.868 ERROR 77632 --- [alarm-detect-25,cbe12cb0587d48c5,9690caae761e] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.869 ERROR 77632 --- [alarm-detect-25,cbe12cb0587d48c5,9690caae761e] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=vpc_connect_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.871 WARN 77632 --- [alarm-detect-16,cbe12cb0587d48c5,3dbc23bcdbcb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.871 ERROR 77632 --- [alarm-detect-16,cbe12cb0587d48c5,3dbc23bcdbcb] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.871 ERROR 77632 --- [alarm-detect-16,cbe12cb0587d48c5,3dbc23bcdbcb] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_etcd_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.871 WARN 77632 --- [alarm-detect-21,cbe12cb0587d48c5,c84a3470991c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.871 ERROR 77632 --- [alarm-detect-21,cbe12cb0587d48c5,c84a3470991c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.872 ERROR 77632 --- [alarm-detect-21,cbe12cb0587d48c5,c84a3470991c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_leader_switched org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.872 WARN 77632 --- [alarm-detect-20,cbe12cb0587d48c5,b4f43d0f2140] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.872 ERROR 77632 --- [alarm-detect-20,cbe12cb0587d48c5,b4f43d0f2140] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.872 ERROR 77632 --- [alarm-detect-20,cbe12cb0587d48c5,b4f43d0f2140] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_ntp_service_not_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.873 WARN 77632 --- [alarm-detect-11,cbe12cb0587d48c5,3891ad5ccbeb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.873 ERROR 77632 --- [alarm-detect-11,cbe12cb0587d48c5,3891ad5ccbeb] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.873 ERROR 77632 --- [alarm-detect-11,cbe12cb0587d48c5,3891ad5ccbeb] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=standby_tenant_sync_status_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.873 WARN 77632 --- [alarm-detect-3,cbe12cb0587d48c5,f4f76a56a076] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.873 ERROR 77632 --- [alarm-detect-3,cbe12cb0587d48c5,f4f76a56a076] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.874 ERROR 77632 --- [alarm-detect-3,cbe12cb0587d48c5,f4f76a56a076] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_task_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.874 WARN 77632 --- [alarm-detect-24,cbe12cb0587d48c5,17dd2bdc7b50] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.874 ERROR 77632 --- [alarm-detect-24,cbe12cb0587d48c5,17dd2bdc7b50] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.875 ERROR 77632 --- [alarm-detect-24,cbe12cb0587d48c5,17dd2bdc7b50] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_sys_abnormal org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.875 WARN 77632 --- [alarm-detect-10,cbe12cb0587d48c5,d648bc756e34] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.875 ERROR 77632 --- [alarm-detect-10,cbe12cb0587d48c5,d648bc756e34] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.875 ERROR 77632 --- [alarm-detect-10,cbe12cb0587d48c5,d648bc756e34] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_invalid_disk_exists org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.875 WARN 77632 --- [alarm-detect-12,cbe12cb0587d48c5,851b0f3ded42] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.875 ERROR 77632 --- [alarm-detect-12,cbe12cb0587d48c5,851b0f3ded42] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.876 ERROR 77632 --- [alarm-detect-12,cbe12cb0587d48c5,851b0f3ded42] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_keepalived_master_switched org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.876 WARN 77632 --- [alarm-detect-8,cbe12cb0587d48c5,e6f2194730da] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.876 ERROR 77632 --- [alarm-detect-8,cbe12cb0587d48c5,e6f2194730da] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.876 ERROR 77632 --- [alarm-detect-8,cbe12cb0587d48c5,e6f2194730da] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_exists_inactive_server org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.877 WARN 77632 --- [alarm-detect-9,cbe12cb0587d48c5,51e53ab0caef] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.877 ERROR 77632 --- [alarm-detect-9,cbe12cb0587d48c5,51e53ab0caef] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.877 ERROR 77632 --- [alarm-detect-9,cbe12cb0587d48c5,51e53ab0caef] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_tcp_retrans_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.877 WARN 77632 --- [alarm-detect-14,cbe12cb0587d48c5,0d9957650a2c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.877 ERROR 77632 --- [alarm-detect-14,cbe12cb0587d48c5,0d9957650a2c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.878 ERROR 77632 --- [alarm-detect-14,cbe12cb0587d48c5,0d9957650a2c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.878 WARN 77632 --- [alarm-detect-26,cbe12cb0587d48c5,671eb854cd03] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.878 ERROR 77632 --- [alarm-detect-26,cbe12cb0587d48c5,671eb854cd03] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.878 ERROR 77632 --- [alarm-detect-26,cbe12cb0587d48c5,671eb854cd03] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.879 WARN 77632 --- [alarm-detect-6,cbe12cb0587d48c5,60a4cac5e0c3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.880 ERROR 77632 --- [alarm-detect-6,cbe12cb0587d48c5,60a4cac5e0c3] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.880 ERROR 77632 --- [alarm-detect-6,cbe12cb0587d48c5,60a4cac5e0c3] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_load1_per_cpu_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.880 WARN 77632 --- [alarm-detect-5,cbe12cb0587d48c5,d8e9e5ea88b4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.880 ERROR 77632 --- [alarm-detect-5,cbe12cb0587d48c5,d8e9e5ea88b4] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.881 ERROR 77632 --- [alarm-detect-5,cbe12cb0587d48c5,d8e9e5ea88b4] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_http_request_too_many_errors_occur org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.881 WARN 77632 --- [alarm-detect-23,cbe12cb0587d48c5,6c96056a097f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.881 ERROR 77632 --- [alarm-detect-23,cbe12cb0587d48c5,6c96056a097f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.881 WARN 77632 --- [alarm-detect-30,cbe12cb0587d48c5,9973e9241eaf] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.881 ERROR 77632 --- [alarm-detect-30,cbe12cb0587d48c5,9973e9241eaf] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.882 ERROR 77632 --- [alarm-detect-30,cbe12cb0587d48c5,9973e9241eaf] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=mgragent_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.882 ERROR 77632 --- [alarm-detect-23,cbe12cb0587d48c5,6c96056a097f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxy_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.887 WARN 77632 --- [alarm-detect-13,cbe12cb0587d48c5,154ddcb972d9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.887 ERROR 77632 --- [alarm-detect-13,cbe12cb0587d48c5,154ddcb972d9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.888 ERROR 77632 --- [alarm-detect-13,cbe12cb0587d48c5,154ddcb972d9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_meta_db_disconnected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.888 WARN 77632 --- [alarm-detect-19,cbe12cb0587d48c5,3aac37dae86d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.888 ERROR 77632 --- [alarm-detect-19,cbe12cb0587d48c5,3aac37dae86d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.889 ERROR 77632 --- [alarm-detect-19,cbe12cb0587d48c5,3aac37dae86d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_compaction_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.889 WARN 77632 --- [alarm-detect-28,cbe12cb0587d48c5,543fbd29e0e6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.889 ERROR 77632 --- [alarm-detect-28,cbe12cb0587d48c5,543fbd29e0e6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.890 ERROR 77632 --- [alarm-detect-28,cbe12cb0587d48c5,543fbd29e0e6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_disk_readonly org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.890 WARN 77632 --- [alarm-detect-29,cbe12cb0587d48c5,8bb936112cd0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.890 ERROR 77632 --- [alarm-detect-29,cbe12cb0587d48c5,8bb936112cd0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.891 ERROR 77632 --- [alarm-detect-29,cbe12cb0587d48c5,8bb936112cd0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_sync_delay_time_too_long org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.891 WARN 77632 --- [alarm-detect-7,cbe12cb0587d48c5,302d977b5225] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.891 ERROR 77632 --- [alarm-detect-7,cbe12cb0587d48c5,302d977b5225] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.891 ERROR 77632 --- [alarm-detect-7,cbe12cb0587d48c5,302d977b5225] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_http_request_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.892 WARN 77632 --- [alarm-detect-27,cbe12cb0587d48c5,28724a7ccf47] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.892 ERROR 77632 --- [alarm-detect-27,cbe12cb0587d48c5,28724a7ccf47] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.892 WARN 77632 --- [alarm-detect-22,cbe12cb0587d48c5,a14939894527] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.892 ERROR 77632 --- [alarm-detect-22,cbe12cb0587d48c5,a14939894527] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.892 ERROR 77632 --- [alarm-detect-22,cbe12cb0587d48c5,a14939894527] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_keepalived_service_inactive org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.893 WARN 77632 --- [alarm-detect-1,cbe12cb0587d48c5,f31392fc732d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.893 ERROR 77632 --- [alarm-detect-1,cbe12cb0587d48c5,f31392fc732d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:35.893 ERROR 77632 --- [alarm-detect-1,cbe12cb0587d48c5,f31392fc732d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.894 ERROR 77632 --- [alarm-detect-27,cbe12cb0587d48c5,28724a7ccf47] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:35.896 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:35.896 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 932, createErrorCount 23 2024-06-04 10:49:35.896 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.897 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 932, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:35.905 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.925 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.926 WARN 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:35.996 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.153 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.272 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.284 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.302 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.317 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.744 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:36.860 WARN 77632 --- [pool-overview-container-6,bc3a8f61497e4832,139a52d70c37] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.860 ERROR 77632 --- [pool-overview-container-6,bc3a8f61497e4832,139a52d70c37] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1896, createErrorCount 23 2024-06-04 10:49:36.861 ERROR 77632 --- [pool-overview-container-6,bc3a8f61497e4832,139a52d70c37] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1896, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.861 WARN 77632 --- [pool-overview-container-6,bc3a8f61497e4832,139a52d70c37] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1896, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.864 WARN 77632 --- [pool-overview-container-7,a6117ca0bd9e44bc,9f400b64888e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.864 WARN 77632 --- [pool-overview-container-2,70aa437300564c64,bc2b09757a6f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.864 ERROR 77632 --- [pool-overview-container-2,70aa437300564c64,bc2b09757a6f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 2024-06-04 10:49:36.864 ERROR 77632 --- [pool-overview-container-7,a6117ca0bd9e44bc,9f400b64888e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 2024-06-04 10:49:36.864 ERROR 77632 --- [pool-overview-container-7,a6117ca0bd9e44bc,9f400b64888e] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.865 WARN 77632 --- [pool-overview-container-5,0027bd778fc0454b,4bfe6045902a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.865 ERROR 77632 --- [pool-overview-container-5,0027bd778fc0454b,4bfe6045902a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1901, createErrorCount 23 2024-06-04 10:49:36.865 WARN 77632 --- [pool-overview-container-7,a6117ca0bd9e44bc,9f400b64888e] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.865 ERROR 77632 --- [pool-overview-container-5,0027bd778fc0454b,4bfe6045902a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1901, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.865 WARN 77632 --- [pool-overview-container-5,0027bd778fc0454b,4bfe6045902a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1901, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.864 ERROR 77632 --- [pool-overview-container-2,70aa437300564c64,bc2b09757a6f] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.865 WARN 77632 --- [pool-overview-container-2,70aa437300564c64,bc2b09757a6f] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1900, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.874 WARN 77632 --- [pool-overview-container-3,e0e644937eb44559,552db9320359] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.874 ERROR 77632 --- [pool-overview-container-3,e0e644937eb44559,552db9320359] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 23 2024-06-04 10:49:36.875 ERROR 77632 --- [pool-overview-container-3,e0e644937eb44559,552db9320359] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.875 WARN 77632 --- [pool-ocp-async-5,389bb5bbda1d462e,d4d3b976b112] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.875 ERROR 77632 --- [pool-ocp-async-5,389bb5bbda1d462e,d4d3b976b112] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1911, createErrorCount 23 2024-06-04 10:49:36.875 WARN 77632 --- [pool-overview-container-3,e0e644937eb44559,552db9320359] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1910, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.884 WARN 77632 --- [pool-overview-container-1,dd38bbd363be439f,6120c2debc56] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.884 ERROR 77632 --- [pool-overview-container-1,dd38bbd363be439f,6120c2debc56] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 23 2024-06-04 10:49:36.884 ERROR 77632 --- [pool-overview-container-1,dd38bbd363be439f,6120c2debc56] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.885 WARN 77632 --- [pool-overview-container-1,dd38bbd363be439f,6120c2debc56] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1920, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.917 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1953, createErrorCount 23 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1953, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.918 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:36.918 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:36.918 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1954, createErrorCount 23 2024-06-04 10:49:36.919 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1954, createErrorCount 23 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.935 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:36.940 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1976, createErrorCount 23 2024-06-04 10:49:36.968 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:37.018 INFO 77632 --- [pool-ocp-async-10,fc777d3ca9a24922,120f440de270] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:37.019 WARN 77632 --- [pool-ocp-async-8,b6493f2486e54b6c,17fc80b95797] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.019 WARN 77632 --- [pool-ocp-async-7,e96713f469ee47ca,2dbf62446315] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.019 ERROR 77632 --- [pool-ocp-async-7,e96713f469ee47ca,2dbf62446315] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 24 2024-06-04 10:49:37.019 WARN 77632 --- [pool-ocp-async-4,e2e91daea2974965,4a3a0b2b9309] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.019 ERROR 77632 --- [pool-ocp-async-4,e2e91daea2974965,4a3a0b2b9309] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 24 2024-06-04 10:49:37.021 WARN 77632 --- [pool-ocp-async-6,a839bcb034e948d4,908a3ef69429] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.021 ERROR 77632 --- [pool-ocp-async-6,a839bcb034e948d4,908a3ef69429] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 24 2024-06-04 10:49:37.022 WARN 77632 --- [pool-ocp-async-3,14f2ddb989c341e8,ee57e7a34813] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.042 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.472 WARN 77632 --- [pool-ocp-schedules-17,9f324727daf94137,4b3ce2e80bf1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.734 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.809 WARN 77632 --- [pool-ocp-schedules-2,00c8297cc4f64d68,932e37370b44] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:37.897 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.897 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 428, createErrorCount 24 2024-06-04 10:49:37.905 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.905 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 436, createErrorCount 24 2024-06-04 10:49:37.906 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 436, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:37.925 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.925 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 456, createErrorCount 24 2024-06-04 10:49:37.926 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:37.927 WARN 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.927 ERROR 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 458, createErrorCount 24 2024-06-04 10:49:37.927 ERROR 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 458, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:37.927 INFO 77632 --- [pool-prometheus-minute-schedule-1,49ee3348ef6d4b11,ddb396bfc957] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469373926, count=0, elapsed=4001 2024-06-04 10:49:37.927 INFO 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:37.996 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:37.996 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 527, createErrorCount 24 2024-06-04 10:49:37.996 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:38.153 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:38.153 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 684, createErrorCount 24 2024-06-04 10:49:38.154 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:38.273 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:38.273 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 804, createErrorCount 24 2024-06-04 10:49:38.273 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:38.284 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:38.285 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 815, createErrorCount 24 2024-06-04 10:49:38.285 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 815, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:38.302 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 833, createErrorCount 24 2024-06-04 10:49:38.318 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:38.318 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 849, createErrorCount 24 2024-06-04 10:49:38.318 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:38.744 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:38.744 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1275, createErrorCount 24 2024-06-04 10:49:38.744 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1275, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:38.940 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.018 INFO 77632 --- [pool-ocp-async-2,34612c42e112467a,6198b574571c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:39.019 WARN 77632 --- [pool-ocp-async-1,938d366089834410,2403cd0cd990] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.019 WARN 77632 --- [pool-ocp-async-9,b6490853d2a54b4a,6d5bc0a1e0f2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.021 WARN 77632 --- [pool-ocp-async-8,b6493f2486e54b6c,17fc80b95797] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.021 ERROR 77632 --- [pool-ocp-async-8,b6493f2486e54b6c,17fc80b95797] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1552, createErrorCount 24 2024-06-04 10:49:39.022 WARN 77632 --- [pool-ocp-async-3,14f2ddb989c341e8,ee57e7a34813] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.022 ERROR 77632 --- [pool-ocp-async-3,14f2ddb989c341e8,ee57e7a34813] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1553, createErrorCount 24 2024-06-04 10:49:39.028 WARN 77632 --- [pool-ocp-async-10,fc777d3ca9a24922,120f440de270] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.029 WARN 77632 --- [pool-ocp-async-2,34612c42e112467a,6198b574571c] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:39.042 WARN 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.042 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1573, createErrorCount 24 2024-06-04 10:49:39.045 ERROR 77632 --- [pool-ocp-schedules-3,b10c9c9b215946ec,09b24f47b349] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy366.findAllByKeywordPageable(Unknown Source) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl.listArbitrationServices(ArbitrationServiceImpl.java:292) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl$$FastClassBySpringCGLIB$$582de4a9.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl$$EnhancerBySpringCGLIB$$556d8044.listArbitrationServices() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildArbitrationAlarmTarget(OcpHostAlarmTargetProvider.java:103) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$PagedExecution.doExecute(JpaQueryExecution.java:179) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1573, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 77 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:39.438 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:39.471 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:39.473 WARN 77632 --- [pool-ocp-schedules-17,9f324727daf94137,4b3ce2e80bf1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.473 ERROR 77632 --- [pool-ocp-schedules-17,9f324727daf94137,4b3ce2e80bf1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 25 2024-06-04 10:49:39.473 ERROR 77632 --- [pool-ocp-schedules-17,9f324727daf94137,4b3ce2e80bf1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 25 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:39.735 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.735 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 25 2024-06-04 10:49:39.735 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:39.810 WARN 77632 --- [pool-ocp-schedules-2,00c8297cc4f64d68,932e37370b44] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:39.810 ERROR 77632 --- [pool-ocp-schedules-2,00c8297cc4f64d68,932e37370b44] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 25 2024-06-04 10:49:39.810 ERROR 77632 --- [pool-ocp-schedules-2,00c8297cc4f64d68,932e37370b44] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 25 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:39.898 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.927 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:39.927 WARN 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:40.697 WARN 77632 --- [pool-ocp-schedules-11,c38c7dcf7a134e90,e430257af0ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:40.901 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:40.926 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:40.940 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 969, createErrorCount 25 2024-06-04 10:49:40.998 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.019 INFO 77632 --- [pool-ocp-async-6,4c8fc4a675074397,1ad867e81df5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:41.019 WARN 77632 --- [pool-ocp-async-5,f1f33d861fa14229,a24a0b70a2d8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.019 WARN 77632 --- [pool-ocp-async-1,938d366089834410,2403cd0cd990] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.019 ERROR 77632 --- [pool-ocp-async-1,938d366089834410,2403cd0cd990] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1047, createErrorCount 25 2024-06-04 10:49:41.019 WARN 77632 --- [pool-ocp-async-9,b6490853d2a54b4a,6d5bc0a1e0f2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.019 ERROR 77632 --- [pool-ocp-async-9,b6490853d2a54b4a,6d5bc0a1e0f2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1047, createErrorCount 25 2024-06-04 10:49:41.021 WARN 77632 --- [pool-ocp-async-7,5c33a91122f24493,37f180ec42f8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.028 WARN 77632 --- [pool-ocp-async-10,fc777d3ca9a24922,120f440de270] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.028 ERROR 77632 --- [pool-ocp-async-10,fc777d3ca9a24922,120f440de270] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1056, createErrorCount 25 2024-06-04 10:49:41.154 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.285 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.745 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.898 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.898 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,4a33c0122c754a0e,ddbdd400aa12] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1926, createErrorCount 25 2024-06-04 10:49:41.899 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.web.util.WebUtils.getSessionId(WebUtils.java:359) at org.springframework.web.servlet.FrameworkServlet.publishRequestHandledEvent(FrameworkServlet.java:1145) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1023) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) at javax.servlet.http.HttpServlet.service(HttpServlet.java:502) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 70 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1926, createErrorCount 25 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 77 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:41.914 INFO 77632 --- [pool-prometheus-cache-monitor1,259007998ec2467f,9f5f57f843c4] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1744,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":4854,"secondWriteQueue":0,"minuteWriteCacheSize":955} 2024-06-04 10:49:41.914 INFO 77632 --- [pool-prometheus-cache-monitor1,259007998ec2467f,9f5f57f843c4] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, node_memory_sreclaimable_bytes=12, ob_sysstat_40011=17, ob_server_resource_memory_assigned_bytes=10, ob_sysstat_40010=17, tcp_retrans=13, ob_unit_num=10, ob_database_disk_required_size=31, go_memstats_mspan_sys_bytes=10, ob_sysstat_30213=17, go_memstats_stack_sys_bytes=10, ob_sysstat_30212=17, exporter_export_metrics_bytes_total=20, ob_sysstat_30217=17, node_filesystem_size_bytes=35, ob_sysstat_30216=17, http_server_requests_seconds_count=60, ob_tenant_request_queue_total_size=20, jvm_gc_memory_allocated_bytes_total=5, ob_system_event_total_waits=21, monagent_input_sql_duration_seconds_sum=55, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=15, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=5, node_filesystem_readonly=35, go_memstats_frees_total=10, io_await=31, host_available=7, ob_sysstat_30220=17, ob_sysstat_30222=17, ob_sysstat_30221=17, go_memstats_mallocs_total=10, ob_unit_config_max_memory_bytes=19, ob_database_disk_data_size=30, io_util=31, ob_sysstat_200002=17, ob_tenant_memstore_freeze_cnt=14, ob_sysstat_200001=17, ob_tenant_disk_v4_data_size=12, ob_tenant_unit_min_memory=26, ob_sysstat_60087=17, ob_memstore_total_bytes=20, metric_cardinality_count=12, jvm_threads_states_threads=10, process_resident_memory_bytes=10, ob_cache_size_bytes=28, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=26, input_collect_metrics_total=15, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=20, node_disk_write_time_seconds_total=20, cpu_count=13, ob_cluster_sync=6, process_open_fds=10, ob_sysstat_50037=17, process_memory_rss_bytes=17, http_status_count=13, process_max_fds=10, ob_server_resource_cpu_assigned_percent=10, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=122, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=10, go_memstats_mcache_sys_bytes=10, ob_sysstat_40118=17, ob_sysstat_40117=17, ob_tenant_disk_v4_log_size=12, node_memory_memfree_bytes=12, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=26, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=15, ob_sysstat_40001=17, ob_server_resource_disk_bytes=10, ocp_alarm_detect_duration_ms_sum=122, ob_sysstat_40000=17, jvm_threads_live_threads=5, ob_sysstat_30200=17, ob_sysstat_30201=17, ob_sysstat_30204=17, ob_sysstat_30205=17, ob_sysstat_30208=17, process_thread_count=17, ob_sysstat_30209=17, node_memory_cached_bytes=12, ob_sysstat_50040=17, ob_table_num=16, ob_sysstat_40009=17, ob_sysstat_40008=17, ob_disk_free_bytes=10, node_filesystem_avail_bytes=35, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=19, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=16, go_memstats_last_gc_time_seconds=10, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=10, ocp_monitor_collect_request_duration_ms_count=9, monagent_oceanbase_plan_explain_size=3, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=31, node_disk_read_bytes_total=20, clock_diff_milliseconds=6, ob_compaction_is_suspended=12, go_memstats_lookups_total=10, process_cpu_percent=17, log_tailer_count=10, ob_sysstat_60057=17, host_agent_process_status=10, ob_server_resource_cpu=10, go_memstats_alloc_bytes=10, ob_server_num=14, node_cpu_seconds_total_native=18, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_session_all_num=16, ob_tenant_resource_min_memory=16, jvm_gc_pause_seconds_count=9, ob_memstore_freeze_times=20, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=5, ob_system_event_time_waited=21, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=24, jvm_memory_committed_bytes=12, node_net_bandwidth_bps=16, monagent_oceanbase_db_pool_idle=3, ob_tenant_server_data_index_data_size=15, go_memstats_heap_idle_bytes=10, go_memstats_gc_sys_bytes=10, ob_server_resource_memory_bytes=10, go_info=11, ob_tenant_assigned_mem_assigned=16, log_tailer_processed_file_count=10, node_load15=12, ob_tenant_memstore_minor_freeze_times=14, ob_disk_log_assigned_bytes=10, ob_tenant_server_required_size=15, jvm_memory_max_bytes=12, ob_unit_config_min_iops=19, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=17, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_sysstat_30084=17, ob_tenant_unit_max_cpu=26, ob_sysstat_30083=17, node_memory_buffers_bytes=12, ob_sysstat_30086=17, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=10, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=16, ob_sysstat_50005=17, ob_sysstat_50008=17, ob_memstore_freeze_trigger_bytes=20, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=11, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=10, ob_session_active_num=16, node_filesystem_files_free=43, ob_memtable_max_snapshot_duration_seconds=10, node_disk_read_time_seconds_total=20, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=3, ob_sysstat_60024=17, ob_compaction_frozen_version=12, ob_sysstat_60023=17, metric_count=10, ob_sysstat_60022=17, process_virtual_memory_bytes=10, observer_coredump_time_seconds=10, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=26, ob_unit_config_max_cpu=19, http_request_milliseconds_summary_count=27, monagent_oceanbase_audit_timeinfo_cache_size=3, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=59, ob_sysstat_20001=17, node_cpu_seconds_total=20, ob_sysstat_20000=17, http_request_milliseconds_summary=30, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=12, go_memstats_buck_hash_sys_bytes=10, monagent_pipeline_report_metrics_total=10, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=20, exporter_export_metrics_total=20, ob_disk_log_total_bytes=10, ob_sysstat_60019=17, system_cpu_count=5, process_uptime_seconds=17, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=10, ocp_meta_db_health=6, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=9, ob_disk_total_bytes=10, watch_ob_dir_exists=15, ob_tenant_request_queue_large_size=20, go_memstats_heap_objects=10, go_memstats_mcache_inuse_bytes=10, go_memstats_other_sys_bytes=10, ob_sysstat_130000=17, jvm_memory_used_bytes=12, ob_sysstat_130001=17, go_threads=10, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=27, http_server_requests_seconds_sum=60, ob_memstore_active_bytes=20, go_memstats_alloc_bytes_total=10, ob_tenant_assigned_mem_total=16, process_count=18, node_memory_memtotal_bytes=12, node_network_transmit_drop_total=16, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=5, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=10, ob_tenant500_memory_used_bytes=10, node_network_transmit_bytes_total=16, ob_compaction_is_error=12, node_network_receive_drop_total=16, monagent_pipeline_execute_total=16, node_filesystem_files=43, process_start_time_seconds=10, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=10, ob_tenant_resource_max_cpu=16, go_gc_duration_seconds_sum=10, go_memstats_mspan_inuse_bytes=10, ob_server_resource_memory_assigned_percent=10, monagent_pipeline_execute_seconds_total=16, jvm_gc_pause_seconds_sum=9, ob_sysstat_80001=17, go_memstats_sys_bytes=10, node_network_receive_errs_total=16, system_load_average_1m=5, monagent_oceanbase_audit_stat_cache_size=3, observer_ulimit_max_fd_count=10, ob_plan_cache_access_total=16, ob_tenant_memory_used_bytes=16, monagent_oceanbase_plan_cache_size=3, monagent_oceanbase_audit_sample_cache_size=3, ob_tenant_server_data_size=15, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=20, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=10, node_load1=12, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=5, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=10, ob_sysstat_120008=17, node_load5=12, ob_sysstat_120005=17, jvm_threads_peak_threads=5, ob_sysstat_120006=17, process_cpu_usage=5, monagent_input_sql_duration_seconds_count=55, node_disk_written_bytes_total=20, monagent_oceanbase_ash_cache_size=3, monagent_pipeline_process_metrics_total=20, go_goroutines=10, ob_compaction_last_version=12, ob_sysstat_30000=17, ob_sysstat_30002=17, ob_server_resource_cpu_assigned=10, ob_sysstat_30001=17, ob_unit_config_min_cpu=19, process_virtual_memory_max_bytes=10, monagent_oceanbase_plan_timeinfo_cache_size=3, monagent_plugin_execute_total=24, ob_sysstat_30006=17, ob_tenant500_memory_hold_bytes=10, ob_sysstat_30005=17, arbitration_status_inactive_server_count=6, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=12, ob_clog_max_sync_delay_seconds=13, oceanbase_connectivity=12} 2024-06-04 10:49:41.919 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.922 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:41.927 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.927 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 25 2024-06-04 10:49:41.927 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1955, createErrorCount 25 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:41.928 WARN 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:41.928 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1956, createErrorCount 25 2024-06-04 10:49:41.928 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1956, createErrorCount 25 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:41.928 INFO 77632 --- [pool-prometheus-minute-schedule-1,5f2ea5c0fc1a4206,db7594ef4f1b] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469377927, count=0, elapsed=4001 2024-06-04 10:49:41.928 INFO 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:41.941 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:41.974 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:42.621 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:42.621 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:42.694 INFO 77632 --- [pool-ocp-async-1,ab39b2cf5742454e,0f922fcd5263] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:42.697 WARN 77632 --- [pool-ocp-schedules-11,c38c7dcf7a134e90,e430257af0ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:42.697 ERROR 77632 --- [pool-ocp-schedules-11,c38c7dcf7a134e90,e430257af0ab] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:42.697 ERROR 77632 --- [pool-ocp-schedules-11,c38c7dcf7a134e90,e430257af0ab] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:42.726 WARN 77632 --- [pool-scanner-12351-1,ab39b2cf5742454e,d9b8a66f802a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:42.874 INFO 77632 --- [pool-ocp-async-3,e6ca52263bef4d78,345bbcda5ffd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:42.901 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:42.901 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:42.901 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:42.907 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:42.926 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:42.926 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:42.926 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:42.941 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:42.998 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:42.998 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:42.998 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:43.019 INFO 77632 --- [pool-ocp-async-10,e5da7e00abb34f04,b581d6179614] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:43.019 WARN 77632 --- [pool-ocp-async-4,fc8ac573b9374d80,c0e2fbab5c2b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.019 WARN 77632 --- [pool-ocp-async-5,f1f33d861fa14229,a24a0b70a2d8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.019 ERROR 77632 --- [pool-ocp-async-5,f1f33d861fa14229,a24a0b70a2d8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:43.019 WARN 77632 --- [pool-ocp-async-8,946d26428106438c,c0a8ad62b5db] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.021 WARN 77632 --- [pool-ocp-async-7,5c33a91122f24493,37f180ec42f8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.021 ERROR 77632 --- [pool-ocp-async-7,5c33a91122f24493,37f180ec42f8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 27 2024-06-04 10:49:43.028 WARN 77632 --- [pool-ocp-async-6,4c8fc4a675074397,1ad867e81df5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.029 WARN 77632 --- [pool-ocp-async-10,e5da7e00abb34f04,b581d6179614] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:43.154 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.154 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 31, createErrorCount 27 2024-06-04 10:49:43.154 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:43.285 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.285 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 163, createErrorCount 27 2024-06-04 10:49:43.286 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 163, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:43.587 WARN 77632 --- [pool-ocp-schedules-12,a4c47d144ebb4cdc,b758a06bbb01] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.745 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.745 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 622, createErrorCount 27 2024-06-04 10:49:43.745 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 622, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:43.900 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.915 WARN 77632 --- [pool-prometheus-exporter-check1,ac213bf5b60744dd,74a9f2ee1a62] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:43.920 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 797, createErrorCount 27 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 797, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:43.920 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:43.922 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:43.922 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 799, createErrorCount 27 2024-06-04 10:49:43.923 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 799, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:43.928 WARN 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.694 WARN 77632 --- [alarm-detect-18,ab39b2cf5742454e,10ae8b9ab031] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.695 WARN 77632 --- [alarm-detect-17,ab39b2cf5742454e,3cf0fef0a7c2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.695 WARN 77632 --- [alarm-detect-15,ab39b2cf5742454e,781ff24f9be2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.694 WARN 77632 --- [alarm-detect-2,ab39b2cf5742454e,2e00c3e011ca] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.860 WARN 77632 --- [pool-overview-container-4,b5c0a6c4d5254092,87b9070d8f9d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.860 WARN 77632 --- [pool-overview-container-8,1bebeced764c436d,f1262c0b71b4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.860 WARN 77632 --- [pool-overview-container-6,1a2afc9d54c94399,a8480f3c30ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.860 WARN 77632 --- [pool-overview-container-7,bfcd4f38d91c4505,f469da8bab2d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.874 WARN 77632 --- [pool-ocp-async-3,e6ca52263bef4d78,345bbcda5ffd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.874 WARN 77632 --- [pool-overview-container-5,7f5986c0ba96419f,1384d17dc294] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.884 WARN 77632 --- [pool-overview-container-2,399830cfb1834841,727fd024210b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:44.907 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:44.907 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1784, createErrorCount 27 2024-06-04 10:49:44.907 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1784, createErrorCount 27 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:44.941 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1818, createErrorCount 27 2024-06-04 10:49:45.019 WARN 77632 --- [pool-ocp-async-4,fc8ac573b9374d80,c0e2fbab5c2b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.019 ERROR 77632 --- [pool-ocp-async-4,fc8ac573b9374d80,c0e2fbab5c2b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1896, createErrorCount 27 2024-06-04 10:49:45.019 WARN 77632 --- [pool-ocp-async-9,644be3395abe4cff,9281237519e6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:45.019 INFO 77632 --- [pool-ocp-async-10,bb0e88d769e946fb,5d715af87f77] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:45.019 WARN 77632 --- [pool-ocp-async-2,00dd701763d14b89,3c411920a52c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:45.019 WARN 77632 --- [pool-ocp-async-8,946d26428106438c,c0a8ad62b5db] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.019 ERROR 77632 --- [pool-ocp-async-8,946d26428106438c,c0a8ad62b5db] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1896, createErrorCount 27 2024-06-04 10:49:45.028 WARN 77632 --- [pool-ocp-async-6,4c8fc4a675074397,1ad867e81df5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.029 ERROR 77632 --- [pool-ocp-async-6,4c8fc4a675074397,1ad867e81df5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1906, createErrorCount 27 2024-06-04 10:49:45.102 INFO 77632 --- [pool-prometheus-second-schedule-1,8c68967ae2864a4a,aa39c03de3c2] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=1, collectTaskCount=1 2024-06-04 10:49:45.124 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.125 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.273 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:45.318 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:45.587 WARN 77632 --- [pool-ocp-schedules-12,a4c47d144ebb4cdc,b758a06bbb01] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.587 ERROR 77632 --- [pool-ocp-schedules-12,a4c47d144ebb4cdc,b758a06bbb01] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 28 2024-06-04 10:49:45.588 ERROR 77632 --- [pool-ocp-schedules-12,a4c47d144ebb4cdc,b758a06bbb01] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 28 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.736 WARN 77632 --- [pool-ocp-async-1,ab39b2cf5742454e,0f922fcd5263] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:49:45.736 WARN 77632 --- [alarm-detect-2,ab39b2cf5742454e,2e00c3e011ca] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.736 ERROR 77632 --- [alarm-detect-2,ab39b2cf5742454e,2e00c3e011ca] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:45.737 ERROR 77632 --- [alarm-detect-2,ab39b2cf5742454e,2e00c3e011ca] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_merge_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:45.737 WARN 77632 --- [alarm-detect-18,ab39b2cf5742454e,10ae8b9ab031] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.737 ERROR 77632 --- [alarm-detect-18,ab39b2cf5742454e,10ae8b9ab031] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:45.737 WARN 77632 --- [alarm-detect-17,ab39b2cf5742454e,3cf0fef0a7c2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.737 ERROR 77632 --- [alarm-detect-17,ab39b2cf5742454e,3cf0fef0a7c2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:45.738 ERROR 77632 --- [alarm-detect-18,ab39b2cf5742454e,10ae8b9ab031] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_drop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:45.738 WARN 77632 --- [alarm-detect-15,ab39b2cf5742454e,781ff24f9be2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.738 ERROR 77632 --- [alarm-detect-15,ab39b2cf5742454e,781ff24f9be2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:49:45.738 ERROR 77632 --- [alarm-detect-15,ab39b2cf5742454e,781ff24f9be2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_nic_1000m_hwm org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:45.738 ERROR 77632 --- [alarm-detect-17,ab39b2cf5742454e,3cf0fef0a7c2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_alarm_detect_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:49:45.900 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.900 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 274, createErrorCount 28 2024-06-04 10:49:45.901 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] threw exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.security.web.context.HttpSessionSecurityContextRepository.loadContext(HttpSessionSecurityContextRepository.java:118) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:100) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294) at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373) at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237) at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 57 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 274, createErrorCount 28 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 64 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.901 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-6,,] o.a.c.c.C.[Tomcat].[localhost] : Exception Processing ErrorPage[errorCode=0, location=/error] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:414) at org.springframework.session.jdbc.JdbcIndexedSessionRepository.findById(JdbcIndexedSessionRepository.java:130) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getRequestedSession(SessionRepositoryFilter.java:351) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:289) at org.springframework.session.web.http.SessionRepositoryFilter$SessionRepositoryRequestWrapper.getSession(SessionRepositoryFilter.java:192) at javax.servlet.http.HttpServletRequestWrapper.getSession(HttpServletRequestWrapper.java:221) at org.springframework.security.web.context.HttpSessionSecurityContextRepository.loadContext(HttpSessionSecurityContextRepository.java:118) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:100) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:102) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:661) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:427) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:357) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:294) at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:373) at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:237) at org.apache.catalina.core.StandardHostValve.throwable(StandardHostValve.java:319) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 57 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 274, createErrorCount 28 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 64 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.916 WARN 77632 --- [pool-prometheus-exporter-check1,ac213bf5b60744dd,74a9f2ee1a62] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.916 ERROR 77632 --- [pool-prometheus-exporter-check1,ac213bf5b60744dd,74a9f2ee1a62] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 290, createErrorCount 28 2024-06-04 10:49:45.916 ERROR 77632 --- [pool-prometheus-exporter-check1,ac213bf5b60744dd,74a9f2ee1a62] c.o.ocp.monitor.OcpMonitorManager : checkActiveExporters failed: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.getAllExporterIdsWithSwitchOn(OcpExporterServiceImpl.java:178) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkActive(OcpExporterStatusCheckServiceImpl.java:87) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$3(OcpMonitorManager.java:144) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 290, createErrorCount 28 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.926 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:45.928 WARN 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:45.929 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 303, createErrorCount 28 2024-06-04 10:49:45.929 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 303, createErrorCount 28 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:45.929 INFO 77632 --- [pool-prometheus-minute-schedule-1,e65ac77d95904ad6,eb689abe7b45] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469381928, count=0, elapsed=4001 2024-06-04 10:49:45.929 INFO 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:45.999 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.078 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.081 INFO 77632 --- [pool-metric-parse-10,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469385, message=java.net.ConnectException: No route to host: /192.168.5.252:62889, rootCause=NoRouteToHostException: No route to host 2024-06-04 10:49:46.081 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.155 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.286 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.718 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.735 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.746 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.860 WARN 77632 --- [pool-overview-container-4,b5c0a6c4d5254092,87b9070d8f9d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.860 WARN 77632 --- [pool-overview-container-7,bfcd4f38d91c4505,f469da8bab2d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.860 ERROR 77632 --- [pool-overview-container-7,bfcd4f38d91c4505,f469da8bab2d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 2024-06-04 10:49:46.860 WARN 77632 --- [pool-overview-container-8,1bebeced764c436d,f1262c0b71b4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.860 ERROR 77632 --- [pool-overview-container-8,1bebeced764c436d,f1262c0b71b4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 2024-06-04 10:49:46.860 WARN 77632 --- [pool-overview-container-6,1a2afc9d54c94399,a8480f3c30ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.860 ERROR 77632 --- [pool-overview-container-6,1a2afc9d54c94399,a8480f3c30ab] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 282, createErrorCount 29 2024-06-04 10:49:46.861 ERROR 77632 --- [pool-overview-container-6,1a2afc9d54c94399,a8480f3c30ab] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 282, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.861 ERROR 77632 --- [pool-overview-container-8,1bebeced764c436d,f1262c0b71b4] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.861 ERROR 77632 --- [pool-overview-container-7,bfcd4f38d91c4505,f469da8bab2d] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.861 WARN 77632 --- [pool-overview-container-6,1a2afc9d54c94399,a8480f3c30ab] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 282, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.861 WARN 77632 --- [pool-overview-container-8,1bebeced764c436d,f1262c0b71b4] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.861 WARN 77632 --- [pool-overview-container-7,bfcd4f38d91c4505,f469da8bab2d] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.860 ERROR 77632 --- [pool-overview-container-4,b5c0a6c4d5254092,87b9070d8f9d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 2024-06-04 10:49:46.862 ERROR 77632 --- [pool-overview-container-4,b5c0a6c4d5254092,87b9070d8f9d] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.862 WARN 77632 --- [pool-overview-container-4,b5c0a6c4d5254092,87b9070d8f9d] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 281, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.874 WARN 77632 --- [pool-overview-container-5,7f5986c0ba96419f,1384d17dc294] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.874 ERROR 77632 --- [pool-overview-container-5,7f5986c0ba96419f,1384d17dc294] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 295, createErrorCount 29 2024-06-04 10:49:46.874 WARN 77632 --- [pool-ocp-async-3,e6ca52263bef4d78,345bbcda5ffd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.874 ERROR 77632 --- [pool-ocp-async-3,e6ca52263bef4d78,345bbcda5ffd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 295, createErrorCount 29 2024-06-04 10:49:46.875 ERROR 77632 --- [pool-overview-container-5,7f5986c0ba96419f,1384d17dc294] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 295, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.875 WARN 77632 --- [pool-overview-container-5,7f5986c0ba96419f,1384d17dc294] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 295, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.884 WARN 77632 --- [pool-overview-container-2,399830cfb1834841,727fd024210b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:46.884 ERROR 77632 --- [pool-overview-container-2,399830cfb1834841,727fd024210b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 305, createErrorCount 29 2024-06-04 10:49:46.885 ERROR 77632 --- [pool-overview-container-2,399830cfb1834841,727fd024210b] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 305, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.885 WARN 77632 --- [pool-overview-container-2,399830cfb1834841,727fd024210b] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 305, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:46.928 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:46.941 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.019 INFO 77632 --- [pool-ocp-async-6,f503b4af5dc14588,6c76d50bfe85] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:47.019 WARN 77632 --- [pool-ocp-async-9,644be3395abe4cff,9281237519e6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.019 ERROR 77632 --- [pool-ocp-async-9,644be3395abe4cff,9281237519e6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 440, createErrorCount 29 2024-06-04 10:49:47.019 WARN 77632 --- [pool-ocp-async-5,e6e07c34432f468f,141783660f7b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.019 WARN 77632 --- [pool-ocp-async-2,00dd701763d14b89,3c411920a52c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.019 ERROR 77632 --- [pool-ocp-async-2,00dd701763d14b89,3c411920a52c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 441, createErrorCount 29 2024-06-04 10:49:47.019 WARN 77632 --- [pool-ocp-async-4,d38e841547194b74,84d7c2f91170] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.029 WARN 77632 --- [pool-ocp-async-10,bb0e88d769e946fb,5d715af87f77] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.029 WARN 77632 --- [pool-ocp-async-6,f503b4af5dc14588,6c76d50bfe85] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:47.273 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.273 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 694, createErrorCount 29 2024-06-04 10:49:47.273 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:47.319 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.319 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 740, createErrorCount 29 2024-06-04 10:49:47.319 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:47.902 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.927 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.927 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1348, createErrorCount 29 2024-06-04 10:49:47.927 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:47.929 WARN 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:47.999 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:47.999 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1420, createErrorCount 29 2024-06-04 10:49:47.999 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:48.155 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:48.155 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1576, createErrorCount 29 2024-06-04 10:49:48.155 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:48.287 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:48.287 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1708, createErrorCount 29 2024-06-04 10:49:48.289 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1708, createErrorCount 29 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.581 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.584 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.719 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] c.o.o.s.c.m.InnerExporterServiceImpl : Failed to collect ocp self-metrics org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 24 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:818) at org.springframework.jdbc.core.JdbcTemplate.queryForList(JdbcTemplate.java:935) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.querySeriesId(SeriesKeyIdPersistent.java:44) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.querySeriesId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.queryAndStoreToCache(SeriesIdKeyService.java:106) at com.oceanbase.ocp.monitor.service.IdKeyService.getId(IdKeyService.java:68) at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.getSeriesId(SeriesIdKeyService.java:89) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.mapMetricLines(RollupMetricDataStore.java:105) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.store(RollupMetricDataStore.java:86) at com.oceanbase.ocp.server.common.metrics.InnerExporterServiceImpl.collect(InnerExporterServiceImpl.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 24 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.735 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:48.735 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:48.735 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:48.746 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:48.746 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:48.746 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.917 WARN 77632 --- [pool-prometheus-exporter-check2,77025286126049dc,fa1f5db7042e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:48.920 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:48.923 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:48.928 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:48.928 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:48.928 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:48.945 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:49.019 INFO 77632 --- [pool-ocp-async-9,ba87a038dabd4fa3,6c4f2df471f1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:49.019 WARN 77632 --- [pool-ocp-async-1,0c610244239a456f,6748eb6f84c5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:49.019 WARN 77632 --- [pool-ocp-async-8,9b5a5ac12a9a4e76,95f683bbc011] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:49.019 WARN 77632 --- [pool-ocp-async-5,e6e07c34432f468f,141783660f7b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:49.019 WARN 77632 --- [pool-ocp-async-4,d38e841547194b74,84d7c2f91170] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:49.020 ERROR 77632 --- [pool-ocp-async-5,e6e07c34432f468f,141783660f7b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:49.020 ERROR 77632 --- [pool-ocp-async-4,d38e841547194b74,84d7c2f91170] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:49.029 WARN 77632 --- [pool-ocp-async-10,bb0e88d769e946fb,5d715af87f77] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:49.029 ERROR 77632 --- [pool-ocp-async-10,bb0e88d769e946fb,5d715af87f77] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 30 2024-06-04 10:49:49.150 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:49.150 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:49.810 INFO 77632 --- [pool-ocp-schedules-2,f4db066afe9744c9,7abccb3bcf07] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:49:49.902 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:49.902 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 251, createErrorCount 31 2024-06-04 10:49:49.903 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 251, createErrorCount 31 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:49.911 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:49.929 WARN 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:49.929 ERROR 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 279, createErrorCount 31 2024-06-04 10:49:49.930 ERROR 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 279, createErrorCount 31 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:49.930 INFO 77632 --- [pool-prometheus-minute-schedule-1,b8c0d7137f7b4676,8f83bc90998b] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469385929, count=0, elapsed=4001 2024-06-04 10:49:49.930 INFO 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:50.302 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:50.918 WARN 77632 --- [pool-prometheus-exporter-check2,77025286126049dc,fa1f5db7042e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:50.918 ERROR 77632 --- [pool-prometheus-exporter-check2,77025286126049dc,fa1f5db7042e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1267, createErrorCount 31 2024-06-04 10:49:50.918 ERROR 77632 --- [pool-prometheus-exporter-check2,77025286126049dc,fa1f5db7042e] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1267, createErrorCount 31 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 27 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:50.923 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:50.924 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1273, createErrorCount 31 2024-06-04 10:49:50.924 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1270, createErrorCount 31 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1270, createErrorCount 31 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:50.924 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:50.924 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1273, createErrorCount 31 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:50.927 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:50.945 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:50.999 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.019 WARN 77632 --- [pool-ocp-async-3,51f6fd2f697b4652,3224ff1a1390] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.019 INFO 77632 --- [pool-ocp-async-5,c9904488a7ac4017,54bfc7470686] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:51.019 WARN 77632 --- [pool-ocp-async-8,9b5a5ac12a9a4e76,95f683bbc011] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:51.019 ERROR 77632 --- [pool-ocp-async-8,9b5a5ac12a9a4e76,95f683bbc011] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1369, createErrorCount 31 2024-06-04 10:49:51.019 WARN 77632 --- [pool-ocp-async-1,0c610244239a456f,6748eb6f84c5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:51.019 ERROR 77632 --- [pool-ocp-async-1,0c610244239a456f,6748eb6f84c5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1369, createErrorCount 31 2024-06-04 10:49:51.019 WARN 77632 --- [pool-ocp-async-7,d53e56a904054ce1,9e28f229d4d7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.029 WARN 77632 --- [pool-ocp-async-9,ba87a038dabd4fa3,6c4f2df471f1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.030 WARN 77632 --- [pool-ocp-async-5,c9904488a7ac4017,54bfc7470686] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:51.155 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.290 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.474 WARN 77632 --- [pool-ocp-schedules-6,a9388abbe07640d8,1ee43addbe1b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.652 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:51.653 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:51.747 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.811 WARN 77632 --- [pool-ocp-schedules-2,f4db066afe9744c9,7abccb3bcf07] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:51.911 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:51.911 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 32 2024-06-04 10:49:51.912 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 32 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:51.930 WARN 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:52.222 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:52.222 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:52.302 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 33 2024-06-04 10:49:52.694 INFO 77632 --- [pool-ocp-async-5,503c612e30914a3d,1d81bd12a1e9] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:49:52.720 WARN 77632 --- [pool-scanner-12371-1,503c612e30914a3d,9db52c0cc736] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:49:52.852 INFO 77632 --- [pool-ocp-schedules-19,65c31f37456a481b,a4b51ea1ee4d] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1744,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":4854,"secondWriteQueue":0,"minuteWriteCacheSize":955} 2024-06-04 10:49:52.852 INFO 77632 --- [pool-ocp-schedules-19,65c31f37456a481b,a4b51ea1ee4d] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, node_memory_sreclaimable_bytes=12, ob_sysstat_40011=17, ob_server_resource_memory_assigned_bytes=10, ob_sysstat_40010=17, tcp_retrans=13, ob_unit_num=10, ob_database_disk_required_size=31, go_memstats_mspan_sys_bytes=10, ob_sysstat_30213=17, go_memstats_stack_sys_bytes=10, ob_sysstat_30212=17, exporter_export_metrics_bytes_total=20, ob_sysstat_30217=17, node_filesystem_size_bytes=35, ob_sysstat_30216=17, http_server_requests_seconds_count=60, ob_tenant_request_queue_total_size=20, jvm_gc_memory_allocated_bytes_total=5, ob_system_event_total_waits=21, monagent_input_sql_duration_seconds_sum=55, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=15, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=5, node_filesystem_readonly=35, go_memstats_frees_total=10, io_await=31, host_available=7, ob_sysstat_30220=17, ob_sysstat_30222=17, ob_sysstat_30221=17, go_memstats_mallocs_total=10, ob_unit_config_max_memory_bytes=19, ob_database_disk_data_size=30, io_util=31, ob_sysstat_200002=17, ob_tenant_memstore_freeze_cnt=14, ob_sysstat_200001=17, ob_tenant_disk_v4_data_size=12, ob_tenant_unit_min_memory=26, ob_sysstat_60087=17, ob_memstore_total_bytes=20, metric_cardinality_count=12, jvm_threads_states_threads=10, process_resident_memory_bytes=10, ob_cache_size_bytes=28, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=26, input_collect_metrics_total=15, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=20, node_disk_write_time_seconds_total=20, cpu_count=13, ob_cluster_sync=6, process_open_fds=10, ob_sysstat_50037=17, process_memory_rss_bytes=17, http_status_count=13, process_max_fds=10, ob_server_resource_cpu_assigned_percent=10, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=122, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=10, go_memstats_mcache_sys_bytes=10, ob_sysstat_40118=17, ob_sysstat_40117=17, ob_tenant_disk_v4_log_size=12, node_memory_memfree_bytes=12, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=26, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=15, ob_sysstat_40001=17, ob_server_resource_disk_bytes=10, ocp_alarm_detect_duration_ms_sum=122, ob_sysstat_40000=17, jvm_threads_live_threads=5, ob_sysstat_30200=17, ob_sysstat_30201=17, ob_sysstat_30204=17, ob_sysstat_30205=17, ob_sysstat_30208=17, process_thread_count=17, ob_sysstat_30209=17, node_memory_cached_bytes=12, ob_sysstat_50040=17, ob_table_num=16, ob_sysstat_40009=17, ob_sysstat_40008=17, ob_disk_free_bytes=10, node_filesystem_avail_bytes=35, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=19, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=16, go_memstats_last_gc_time_seconds=10, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=10, ocp_monitor_collect_request_duration_ms_count=9, monagent_oceanbase_plan_explain_size=3, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=31, node_disk_read_bytes_total=20, clock_diff_milliseconds=6, ob_compaction_is_suspended=12, go_memstats_lookups_total=10, process_cpu_percent=17, log_tailer_count=10, ob_sysstat_60057=17, host_agent_process_status=10, ob_server_resource_cpu=10, go_memstats_alloc_bytes=10, ob_server_num=14, node_cpu_seconds_total_native=18, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_session_all_num=16, ob_tenant_resource_min_memory=16, jvm_gc_pause_seconds_count=9, ob_memstore_freeze_times=20, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=5, ob_system_event_time_waited=21, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=24, jvm_memory_committed_bytes=12, node_net_bandwidth_bps=16, monagent_oceanbase_db_pool_idle=3, ob_tenant_server_data_index_data_size=15, go_memstats_heap_idle_bytes=10, go_memstats_gc_sys_bytes=10, ob_server_resource_memory_bytes=10, go_info=11, ob_tenant_assigned_mem_assigned=16, log_tailer_processed_file_count=10, node_load15=12, ob_tenant_memstore_minor_freeze_times=14, ob_disk_log_assigned_bytes=10, ob_tenant_server_required_size=15, jvm_memory_max_bytes=12, ob_unit_config_min_iops=19, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=17, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_sysstat_30084=17, ob_tenant_unit_max_cpu=26, ob_sysstat_30083=17, node_memory_buffers_bytes=12, ob_sysstat_30086=17, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=10, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=16, ob_sysstat_50005=17, ob_sysstat_50008=17, ob_memstore_freeze_trigger_bytes=20, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=11, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=10, ob_session_active_num=16, node_filesystem_files_free=43, ob_memtable_max_snapshot_duration_seconds=10, node_disk_read_time_seconds_total=20, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=3, ob_sysstat_60024=17, ob_compaction_frozen_version=12, ob_sysstat_60023=17, metric_count=10, ob_sysstat_60022=17, process_virtual_memory_bytes=10, observer_coredump_time_seconds=10, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=26, ob_unit_config_max_cpu=19, http_request_milliseconds_summary_count=27, monagent_oceanbase_audit_timeinfo_cache_size=3, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=59, ob_sysstat_20001=17, node_cpu_seconds_total=20, ob_sysstat_20000=17, http_request_milliseconds_summary=30, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=12, go_memstats_buck_hash_sys_bytes=10, monagent_pipeline_report_metrics_total=10, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=20, exporter_export_metrics_total=20, ob_disk_log_total_bytes=10, ob_sysstat_60019=17, system_cpu_count=5, process_uptime_seconds=17, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=10, ocp_meta_db_health=6, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=9, ob_disk_total_bytes=10, watch_ob_dir_exists=15, ob_tenant_request_queue_large_size=20, go_memstats_heap_objects=10, go_memstats_mcache_inuse_bytes=10, go_memstats_other_sys_bytes=10, ob_sysstat_130000=17, jvm_memory_used_bytes=12, ob_sysstat_130001=17, go_threads=10, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=27, http_server_requests_seconds_sum=60, ob_memstore_active_bytes=20, go_memstats_alloc_bytes_total=10, ob_tenant_assigned_mem_total=16, process_count=18, node_memory_memtotal_bytes=12, node_network_transmit_drop_total=16, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=5, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=10, ob_tenant500_memory_used_bytes=10, node_network_transmit_bytes_total=16, ob_compaction_is_error=12, node_network_receive_drop_total=16, monagent_pipeline_execute_total=16, node_filesystem_files=43, process_start_time_seconds=10, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=10, ob_tenant_resource_max_cpu=16, go_gc_duration_seconds_sum=10, go_memstats_mspan_inuse_bytes=10, ob_server_resource_memory_assigned_percent=10, monagent_pipeline_execute_seconds_total=16, jvm_gc_pause_seconds_sum=9, ob_sysstat_80001=17, go_memstats_sys_bytes=10, node_network_receive_errs_total=16, system_load_average_1m=5, monagent_oceanbase_audit_stat_cache_size=3, observer_ulimit_max_fd_count=10, ob_plan_cache_access_total=16, ob_tenant_memory_used_bytes=16, monagent_oceanbase_plan_cache_size=3, monagent_oceanbase_audit_sample_cache_size=3, ob_tenant_server_data_size=15, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=20, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=10, node_load1=12, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=5, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=10, ob_sysstat_120008=17, node_load5=12, ob_sysstat_120005=17, jvm_threads_peak_threads=5, ob_sysstat_120006=17, process_cpu_usage=5, monagent_input_sql_duration_seconds_count=55, node_disk_written_bytes_total=20, monagent_oceanbase_ash_cache_size=3, monagent_pipeline_process_metrics_total=20, go_goroutines=10, ob_compaction_last_version=12, ob_sysstat_30000=17, ob_sysstat_30002=17, ob_server_resource_cpu_assigned=10, ob_sysstat_30001=17, ob_unit_config_min_cpu=19, process_virtual_memory_max_bytes=10, monagent_oceanbase_plan_timeinfo_cache_size=3, monagent_plugin_execute_total=24, ob_sysstat_30006=17, ob_tenant500_memory_hold_bytes=10, ob_sysstat_30005=17, arbitration_status_inactive_server_count=6, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=12, ob_clog_max_sync_delay_seconds=13, oceanbase_connectivity=12} 2024-06-04 10:49:52.855 INFO 77632 --- [pool-ocp-schedules-9,b8709a519d904bbc,1d1fdbd8353d] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-06-04 10:49:52.874 INFO 77632 --- [pool-ocp-async-5,7635568cd95a4d4b,c180f8a155fe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:49:52.896 INFO 77632 --- [pool-ocp-schedules-19,b39d92f6fe434391,818c615085c1] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-06-04 10:49:52.927 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:52.927 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 203, createErrorCount 33 2024-06-04 10:49:52.927 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:52.945 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 221, createErrorCount 33 2024-06-04 10:49:53.000 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.000 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 276, createErrorCount 33 2024-06-04 10:49:53.000 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:53.019 WARN 77632 --- [pool-ocp-async-3,51f6fd2f697b4652,3224ff1a1390] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.020 ERROR 77632 --- [pool-ocp-async-3,51f6fd2f697b4652,3224ff1a1390] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 296, createErrorCount 33 2024-06-04 10:49:53.020 WARN 77632 --- [pool-ocp-async-7,d53e56a904054ce1,9e28f229d4d7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.020 ERROR 77632 --- [pool-ocp-async-7,d53e56a904054ce1,9e28f229d4d7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 296, createErrorCount 33 2024-06-04 10:49:53.021 WARN 77632 --- [pool-ocp-async-2,080f61ab116d4c23,740bb2bd6b23] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:53.021 WARN 77632 --- [pool-ocp-async-6,2107a92ef9dd4dbc,7a88635b5096] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:53.021 INFO 77632 --- [pool-ocp-async-7,e996d2687f734dbf,389e866eb57b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:53.030 WARN 77632 --- [pool-ocp-async-9,ba87a038dabd4fa3,6c4f2df471f1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.030 ERROR 77632 --- [pool-ocp-async-9,ba87a038dabd4fa3,6c4f2df471f1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 306, createErrorCount 33 2024-06-04 10:49:53.155 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.155 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 432, createErrorCount 33 2024-06-04 10:49:53.156 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:53.248 INFO 77632 --- [pool-ocp-schedules-18,5df6b9ae2ed74dbc,3d045e012fdc] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-06-04 10:49:53.290 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.290 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 566, createErrorCount 33 2024-06-04 10:49:53.290 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 566, createErrorCount 33 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:53.474 WARN 77632 --- [pool-ocp-schedules-6,a9388abbe07640d8,1ee43addbe1b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.474 ERROR 77632 --- [pool-ocp-schedules-6,a9388abbe07640d8,1ee43addbe1b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 750, createErrorCount 33 2024-06-04 10:49:53.474 ERROR 77632 --- [pool-ocp-schedules-6,a9388abbe07640d8,1ee43addbe1b] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 750, createErrorCount 33 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:53.747 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.747 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1023, createErrorCount 33 2024-06-04 10:49:53.747 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1023, createErrorCount 33 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:53.812 WARN 77632 --- [pool-ocp-schedules-2,f4db066afe9744c9,7abccb3bcf07] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.812 ERROR 77632 --- [pool-ocp-schedules-2,f4db066afe9744c9,7abccb3bcf07] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1088, createErrorCount 33 2024-06-04 10:49:53.812 ERROR 77632 --- [pool-ocp-schedules-2,f4db066afe9744c9,7abccb3bcf07] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1088, createErrorCount 33 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:53.929 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:53.930 WARN 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:53.930 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1207, createErrorCount 33 2024-06-04 10:49:53.931 ERROR 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1207, createErrorCount 33 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:53.931 INFO 77632 --- [pool-prometheus-minute-schedule-1,5d9f80db344a4da3,c87cb3f11afe] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469389930, count=0, elapsed=4001 2024-06-04 10:49:53.931 INFO 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:54.274 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.320 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.682 WARN 77632 --- [pool-ocp-schedules-4,c9d21d1edc254aec,05fcf4ff2dae] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.687 WARN 77632 --- [pool-ocp-schedules-1,8a08adaa09dd4483,3257588a89e1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.687 WARN 77632 --- [pool-ocp-schedules-10,c34b619848db45ff,14d1ac5e9d5e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.689 WARN 77632 --- [pool-ocp-schedules-8,f67ba2d2a8804121,2a2321a1ec4e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.690 WARN 77632 --- [pool-ocp-schedules-11,b25de70bf42043dc,859086ea7ef0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.690 WARN 77632 --- [pool-ocp-schedules-12,d59086ad94a34748,bc75c4f73adc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.691 WARN 77632 --- [pool-ocp-schedules-7,e4edb5a3e5de49bd,76997189caac] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.692 WARN 77632 --- [pool-ocp-schedules-14,96d8fa09fa774c51,339cd8c27b25] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.692 WARN 77632 --- [pool-ocp-schedules-16,91bc3615195e45f8,901ec413e5ae] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.694 WARN 77632 --- [pool-ocp-async-8,84cbac2102c2409c,bb484b443dfc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.694 WARN 77632 --- [pool-ocp-async-1,361f23159ec64c23,78200754ddd0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.694 WARN 77632 --- [pool-ocp-async-4,82eab54ed6f64b27,b1f0a5c19fe0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.702 WARN 77632 --- [pool-ocp-schedules-13,c902424dcbfc430c,041a2c79ae72] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.725 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:54.726 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:54.855 WARN 77632 --- [pool-ocp-schedules-9,b8709a519d904bbc,1d1fdbd8353d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.860 WARN 77632 --- [pool-overview-container-3,78beb80516914339,69db674ccd91] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.860 WARN 77632 --- [pool-overview-container-1,d6ec28ba28f24829,4ef31c9c844a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.860 WARN 77632 --- [pool-overview-container-6,b91d11d26bab4088,ef53e59aee47] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.860 WARN 77632 --- [pool-overview-container-8,94b0ffe302d14cca,4c33c7ba17f2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.874 WARN 77632 --- [pool-overview-container-7,137dceb7058e45ad,823e0f666b3b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.874 WARN 77632 --- [pool-ocp-async-5,7635568cd95a4d4b,c180f8a155fe] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.884 WARN 77632 --- [pool-overview-container-4,1de44553c56f44da,8b77de93f875] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.896 WARN 77632 --- [pool-ocp-schedules-19,b39d92f6fe434391,818c615085c1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.903 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:54.945 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.021 WARN 77632 --- [pool-ocp-async-2,080f61ab116d4c23,740bb2bd6b23] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:55.021 ERROR 77632 --- [pool-ocp-async-2,080f61ab116d4c23,740bb2bd6b23] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 34 2024-06-04 10:49:55.021 WARN 77632 --- [pool-ocp-async-10,f591ccb895a946a5,25769b75e06e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.021 WARN 77632 --- [pool-ocp-async-3,8ae3d2d5e85b4126,2336a473d5a0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.021 WARN 77632 --- [pool-ocp-async-6,2107a92ef9dd4dbc,7a88635b5096] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:55.021 ERROR 77632 --- [pool-ocp-async-6,2107a92ef9dd4dbc,7a88635b5096] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 34 2024-06-04 10:49:55.022 INFO 77632 --- [pool-ocp-async-6,88128b0961744b08,ac926776f563] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:55.030 WARN 77632 --- [pool-ocp-async-7,e996d2687f734dbf,389e866eb57b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.032 WARN 77632 --- [pool-ocp-async-6,88128b0961744b08,ac926776f563] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:55.249 WARN 77632 --- [pool-ocp-schedules-18,5df6b9ae2ed74dbc,3d045e012fdc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.293 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:55.293 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:55.736 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.925 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.928 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.929 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:55.929 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 135, createErrorCount 35 2024-06-04 10:49:55.930 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 135, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:55.930 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:55.931 WARN 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.000 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.156 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.274 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.274 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 480, createErrorCount 35 2024-06-04 10:49:56.274 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:49:56.291 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.320 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.320 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 526, createErrorCount 35 2024-06-04 10:49:56.320 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:49:56.682 WARN 77632 --- [pool-ocp-schedules-4,c9d21d1edc254aec,05fcf4ff2dae] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.682 ERROR 77632 --- [pool-ocp-schedules-4,c9d21d1edc254aec,05fcf4ff2dae] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 888, createErrorCount 35 2024-06-04 10:49:56.683 ERROR 77632 --- [pool-ocp-schedules-4,c9d21d1edc254aec,05fcf4ff2dae] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy298.findByKeyAndApplicationAndProfileAndLabel(Unknown Source) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:191) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:186) at com.oceanbase.ocp.service.audit.AuditEventService.enableAudit(AuditEventService.java:306) at com.oceanbase.ocp.service.audit.AuditEventService.refreshMethodToAuditEventMetaMap(AuditEventService.java:313) at com.oceanbase.ocp.service.audit.AuditEventService$$FastClassBySpringCGLIB$$cf41526c.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.audit.AuditEventService$$EnhancerBySpringCGLIB$$b5127495.refreshMethodToAuditEventMetaMap() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 31 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 888, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.687 WARN 77632 --- [pool-ocp-schedules-1,8a08adaa09dd4483,3257588a89e1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.687 ERROR 77632 --- [pool-ocp-schedules-1,8a08adaa09dd4483,3257588a89e1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 893, createErrorCount 35 2024-06-04 10:49:56.687 WARN 77632 --- [pool-ocp-schedules-10,c34b619848db45ff,14d1ac5e9d5e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.687 ERROR 77632 --- [pool-ocp-schedules-10,c34b619848db45ff,14d1ac5e9d5e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 893, createErrorCount 35 2024-06-04 10:49:56.688 ERROR 77632 --- [pool-ocp-schedules-10,c34b619848db45ff,14d1ac5e9d5e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 893, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.688 ERROR 77632 --- [pool-ocp-schedules-1,8a08adaa09dd4483,3257588a89e1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 893, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.689 WARN 77632 --- [pool-ocp-schedules-8,f67ba2d2a8804121,2a2321a1ec4e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.689 ERROR 77632 --- [pool-ocp-schedules-8,f67ba2d2a8804121,2a2321a1ec4e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 895, createErrorCount 35 2024-06-04 10:49:56.690 ERROR 77632 --- [pool-ocp-schedules-8,f67ba2d2a8804121,2a2321a1ec4e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 895, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.690 WARN 77632 --- [pool-ocp-schedules-11,b25de70bf42043dc,859086ea7ef0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.690 ERROR 77632 --- [pool-ocp-schedules-11,b25de70bf42043dc,859086ea7ef0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 896, createErrorCount 35 2024-06-04 10:49:56.691 ERROR 77632 --- [pool-ocp-schedules-11,b25de70bf42043dc,859086ea7ef0] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 896, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.691 WARN 77632 --- [pool-ocp-schedules-12,d59086ad94a34748,bc75c4f73adc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.691 ERROR 77632 --- [pool-ocp-schedules-12,d59086ad94a34748,bc75c4f73adc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 897, createErrorCount 35 2024-06-04 10:49:56.691 ERROR 77632 --- [pool-ocp-schedules-12,d59086ad94a34748,bc75c4f73adc] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 897, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.691 WARN 77632 --- [pool-ocp-schedules-7,e4edb5a3e5de49bd,76997189caac] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.691 ERROR 77632 --- [pool-ocp-schedules-7,e4edb5a3e5de49bd,76997189caac] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 897, createErrorCount 35 2024-06-04 10:49:56.692 ERROR 77632 --- [pool-ocp-schedules-7,e4edb5a3e5de49bd,76997189caac] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 897, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.692 WARN 77632 --- [pool-ocp-schedules-14,96d8fa09fa774c51,339cd8c27b25] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.692 ERROR 77632 --- [pool-ocp-schedules-14,96d8fa09fa774c51,339cd8c27b25] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 898, createErrorCount 35 2024-06-04 10:49:56.692 WARN 77632 --- [pool-ocp-schedules-16,91bc3615195e45f8,901ec413e5ae] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.692 ERROR 77632 --- [pool-ocp-schedules-16,91bc3615195e45f8,901ec413e5ae] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 898, createErrorCount 35 2024-06-04 10:49:56.692 ERROR 77632 --- [pool-ocp-schedules-14,96d8fa09fa774c51,339cd8c27b25] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 898, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.692 ERROR 77632 --- [pool-ocp-schedules-16,91bc3615195e45f8,901ec413e5ae] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 898, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.694 WARN 77632 --- [pool-ocp-async-8,84cbac2102c2409c,bb484b443dfc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.694 ERROR 77632 --- [pool-ocp-async-8,84cbac2102c2409c,bb484b443dfc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 900, createErrorCount 35 2024-06-04 10:49:56.694 WARN 77632 --- [pool-ocp-async-1,361f23159ec64c23,78200754ddd0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.694 ERROR 77632 --- [pool-ocp-async-1,361f23159ec64c23,78200754ddd0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 900, createErrorCount 35 2024-06-04 10:49:56.694 WARN 77632 --- [pool-ocp-async-8,84cbac2102c2409c,bb484b443dfc] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy392.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmSubscriptionService.listAll(OcpAlarmSubscriptionService.java:406) at com.oceanbase.ocp.alarm.core.notification.AlarmStatisticsService.doScheduleTask(AlarmStatisticsService.java:129) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(AlarmNotifier.java:304) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$ca38577b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 900, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.695 WARN 77632 --- [pool-ocp-async-4,82eab54ed6f64b27,b1f0a5c19fe0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.695 ERROR 77632 --- [pool-ocp-async-4,82eab54ed6f64b27,b1f0a5c19fe0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 901, createErrorCount 35 2024-06-04 10:49:56.702 WARN 77632 --- [pool-ocp-schedules-13,c902424dcbfc430c,041a2c79ae72] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.702 ERROR 77632 --- [pool-ocp-schedules-13,c902424dcbfc430c,041a2c79ae72] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 908, createErrorCount 35 2024-06-04 10:49:56.703 ERROR 77632 --- [pool-ocp-schedules-13,c902424dcbfc430c,041a2c79ae72] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 908, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.748 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.856 WARN 77632 --- [pool-ocp-schedules-9,b8709a519d904bbc,1d1fdbd8353d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.856 ERROR 77632 --- [pool-ocp-schedules-9,b8709a519d904bbc,1d1fdbd8353d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1061, createErrorCount 35 2024-06-04 10:49:56.856 ERROR 77632 --- [pool-ocp-schedules-9,b8709a519d904bbc,1d1fdbd8353d] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.core.cache.helper.HostQueryCache.lambda$initHostCache$0(HostQueryCache.java:41) at com.oceanbase.ocp.core.cache.helper.QueryCache.initCache(QueryCache.java:22) at com.oceanbase.ocp.core.cache.helper.HostQueryCache.initHostCache(HostQueryCache.java:41) at com.oceanbase.ocp.core.cache.helper.HostQueryCache.initCache(HostQueryCache.java:36) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1061, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-8,94b0ffe302d14cca,4c33c7ba17f2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-8,94b0ffe302d14cca,4c33c7ba17f2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-3,78beb80516914339,69db674ccd91] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-6,b91d11d26bab4088,ef53e59aee47] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-6,b91d11d26bab4088,ef53e59aee47] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-1,d6ec28ba28f24829,4ef31c9c844a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-3,78beb80516914339,69db674ccd91] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-1,d6ec28ba28f24829,4ef31c9c844a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1067, createErrorCount 35 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-6,b91d11d26bab4088,ef53e59aee47] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-1,d6ec28ba28f24829,4ef31c9c844a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1067, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-3,78beb80516914339,69db674ccd91] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 ERROR 77632 --- [pool-overview-container-8,94b0ffe302d14cca,4c33c7ba17f2] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-6,b91d11d26bab4088,ef53e59aee47] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-1,d6ec28ba28f24829,4ef31c9c844a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1067, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-3,78beb80516914339,69db674ccd91] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.861 WARN 77632 --- [pool-overview-container-8,94b0ffe302d14cca,4c33c7ba17f2] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1066, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.874 WARN 77632 --- [pool-overview-container-7,137dceb7058e45ad,823e0f666b3b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.875 ERROR 77632 --- [pool-overview-container-7,137dceb7058e45ad,823e0f666b3b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1080, createErrorCount 35 2024-06-04 10:49:56.875 ERROR 77632 --- [pool-overview-container-7,137dceb7058e45ad,823e0f666b3b] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1080, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.876 WARN 77632 --- [pool-overview-container-7,137dceb7058e45ad,823e0f666b3b] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1080, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.877 WARN 77632 --- [pool-ocp-async-5,7635568cd95a4d4b,c180f8a155fe] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.877 ERROR 77632 --- [pool-ocp-async-5,7635568cd95a4d4b,c180f8a155fe] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1082, createErrorCount 35 2024-06-04 10:49:56.887 WARN 77632 --- [pool-overview-container-4,1de44553c56f44da,8b77de93f875] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.888 ERROR 77632 --- [pool-overview-container-4,1de44553c56f44da,8b77de93f875] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 1093, createErrorCount 35 2024-06-04 10:49:56.888 ERROR 77632 --- [pool-overview-container-4,1de44553c56f44da,8b77de93f875] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 1093, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.888 WARN 77632 --- [pool-overview-container-4,1de44553c56f44da,8b77de93f875] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 1093, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.897 WARN 77632 --- [pool-ocp-schedules-19,b39d92f6fe434391,818c615085c1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.897 ERROR 77632 --- [pool-ocp-schedules-19,b39d92f6fe434391,818c615085c1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1102, createErrorCount 35 2024-06-04 10:49:56.897 ERROR 77632 --- [pool-ocp-schedules-19,b39d92f6fe434391,818c615085c1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.core.cache.helper.ObProxyQueryCache.lambda$initObProxyClusterCache$0(ObProxyQueryCache.java:47) at com.oceanbase.ocp.core.cache.helper.QueryCache.initCache(QueryCache.java:22) at com.oceanbase.ocp.core.cache.helper.ObProxyQueryCache.initObProxyClusterCache(ObProxyQueryCache.java:47) at com.oceanbase.ocp.core.cache.helper.ObProxyQueryCache.initCache(ObProxyQueryCache.java:41) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1102, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.904 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:56.904 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1109, createErrorCount 35 2024-06-04 10:49:56.904 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1109, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:56.912 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:56.945 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1151, createErrorCount 35 2024-06-04 10:49:57.021 INFO 77632 --- [pool-ocp-async-1,a6aa0d199b4748d3,b02d8e24a8c5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:57.021 WARN 77632 --- [pool-ocp-async-9,96324e611de14f15,9282369ce324] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:57.021 WARN 77632 --- [pool-ocp-async-10,f591ccb895a946a5,25769b75e06e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.021 ERROR 77632 --- [pool-ocp-async-10,f591ccb895a946a5,25769b75e06e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1227, createErrorCount 35 2024-06-04 10:49:57.021 WARN 77632 --- [pool-ocp-async-2,cc54902794994e71,c87ff78a93da] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:57.021 WARN 77632 --- [pool-ocp-async-3,8ae3d2d5e85b4126,2336a473d5a0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.022 ERROR 77632 --- [pool-ocp-async-3,8ae3d2d5e85b4126,2336a473d5a0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1227, createErrorCount 35 2024-06-04 10:49:57.030 WARN 77632 --- [pool-ocp-async-7,e996d2687f734dbf,389e866eb57b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.030 ERROR 77632 --- [pool-ocp-async-7,e996d2687f734dbf,389e866eb57b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1236, createErrorCount 35 2024-06-04 10:49:57.249 WARN 77632 --- [pool-ocp-schedules-18,5df6b9ae2ed74dbc,3d045e012fdc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.249 ERROR 77632 --- [pool-ocp-schedules-18,5df6b9ae2ed74dbc,3d045e012fdc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1455, createErrorCount 35 2024-06-04 10:49:57.249 ERROR 77632 --- [pool-ocp-schedules-18,5df6b9ae2ed74dbc,3d045e012fdc] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy339.findAll(Unknown Source) at com.oceanbase.ocp.core.cache.helper.ObQueryCache.lambda$initClusterCache$0(ObQueryCache.java:67) at com.oceanbase.ocp.core.cache.helper.QueryCache.initCache(QueryCache.java:22) at com.oceanbase.ocp.core.cache.helper.ObQueryCache.initClusterCache(ObQueryCache.java:67) at com.oceanbase.ocp.core.cache.helper.ObQueryCache.initCache(ObQueryCache.java:58) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1455, createErrorCount 35 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.736 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.736 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1942, createErrorCount 35 2024-06-04 10:49:57.736 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:49:57.796 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.796 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.925 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.925 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:57.925 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.928 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.928 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:57.928 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:49:57.930 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.931 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:49:57.931 WARN 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:57.931 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:57.932 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:57.932 INFO 77632 --- [pool-prometheus-minute-schedule-1,f0ae50310dd64009,1a9685c16887] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469393931, count=0, elapsed=4001 2024-06-04 10:49:57.932 INFO 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469400, interval=60 2024-06-04 10:49:58.000 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:58.000 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:58.000 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:49:58.156 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:58.156 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:58.156 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:49:58.292 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:58.292 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 36 2024-06-04 10:49:58.292 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 36 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:58.365 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:58.365 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:58.717 INFO 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=Ren_Test&version=2&ObClusterId=1717467632, client=0:0:0:0:0:0:0:1, traceId=a37ec228047e474a, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469396713876,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2024-06-04 10:49:58.748 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:58.748 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 37 2024-06-04 10:49:58.748 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 37 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:58.841 WARN 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:58.913 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:58.913 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 47, createErrorCount 37 2024-06-04 10:49:58.913 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 47, createErrorCount 37 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:49:58.946 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.011 WARN 77632 --- [pool-ocp-schedules-4,ae1e48cd51da4b8c,8512dd2b93a7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.021 WARN 77632 --- [pool-ocp-async-4,b82abe2eeb064e48,966d0cdf283c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.021 INFO 77632 --- [pool-ocp-async-6,654e5d8b463c4370,dc93aad82693] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:49:59.021 WARN 77632 --- [pool-ocp-async-5,ae7795d84f444ad5,3acf0a8d3809] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.021 WARN 77632 --- [pool-ocp-async-9,96324e611de14f15,9282369ce324] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:59.021 ERROR 77632 --- [pool-ocp-async-9,96324e611de14f15,9282369ce324] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 156, createErrorCount 37 2024-06-04 10:49:59.025 WARN 77632 --- [pool-ocp-async-2,cc54902794994e71,c87ff78a93da] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:49:59.025 ERROR 77632 --- [pool-ocp-async-2,cc54902794994e71,c87ff78a93da] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 159, createErrorCount 37 2024-06-04 10:49:59.030 WARN 77632 --- [pool-ocp-async-1,a6aa0d199b4748d3,b02d8e24a8c5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.031 WARN 77632 --- [pool-ocp-async-6,654e5d8b463c4370,dc93aad82693] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:49:59.160 WARN 77632 --- [pool-ocp-schedules-11,9322d8ecf17b4d50,cf984febff6d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:49:59.932 WARN 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:00.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:50:00.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:50:00.717 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:00.842 INFO 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] c.o.o.a.s.AlarmInMemoryServiceImpl : create alarm ocp_meta_db_disconnected class OcpLabels { {svr_ip=192.168.5.253, db=metadb} } 2024-06-04 10:50:00.868 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:00.868 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:00.928 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:00.930 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:00.946 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.001 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.011 WARN 77632 --- [pool-ocp-schedules-4,ae1e48cd51da4b8c,8512dd2b93a7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.011 ERROR 77632 --- [pool-ocp-schedules-4,ae1e48cd51da4b8c,8512dd2b93a7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.012 ERROR 77632 --- [pool-ocp-schedules-4,ae1e48cd51da4b8c,8512dd2b93a7] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.AlarmSummaryServiceImpl.refreshClusterAlarmSummary(AlarmSummaryServiceImpl.java:94) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmSummary(AlarmSchedules.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:01.021 INFO 77632 --- [pool-ocp-async-7,34f54c9dde5d4ca1,2c3b69198b02] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:01.022 WARN 77632 --- [pool-ocp-async-4,b82abe2eeb064e48,966d0cdf283c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.022 ERROR 77632 --- [pool-ocp-async-4,b82abe2eeb064e48,966d0cdf283c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.021 WARN 77632 --- [pool-ocp-async-10,43351ba552b54319,0269b1892bf3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.022 WARN 77632 --- [pool-ocp-async-5,ae7795d84f444ad5,3acf0a8d3809] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.022 ERROR 77632 --- [pool-ocp-async-5,ae7795d84f444ad5,3acf0a8d3809] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.021 WARN 77632 --- [pool-ocp-async-8,7b7573cf221d445f,a89761e05968] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.031 WARN 77632 --- [pool-ocp-async-1,a6aa0d199b4748d3,b02d8e24a8c5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.031 ERROR 77632 --- [pool-ocp-async-1,a6aa0d199b4748d3,b02d8e24a8c5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.120 INFO 77632 --- [pool-metric-parse-11,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469400, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:50:01.156 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.160 WARN 77632 --- [pool-ocp-schedules-11,9322d8ecf17b4d50,cf984febff6d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.160 ERROR 77632 --- [pool-ocp-schedules-11,9322d8ecf17b4d50,cf984febff6d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 2024-06-04 10:50:01.160 ERROR 77632 --- [pool-ocp-schedules-11,9322d8ecf17b4d50,cf984febff6d] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostVersionSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostVersionSchedule(ClusterSchedules.java:131) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 17 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 38 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:01.295 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.438 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:01.438 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:01.611 WARN 77632 --- [pool-ocp-schedules-17,9f640924550f443d,f6661ee5e004] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.748 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.905 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:01.933 WARN 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:01.933 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 39 2024-06-04 10:50:01.933 ERROR 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:01.933 INFO 77632 --- [pool-prometheus-minute-schedule-1,e392eaf70d8c4fb3,b612c48a924f] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469397932, count=0, elapsed=4001 2024-06-04 10:50:01.933 INFO 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:02.000 WARN 77632 --- [pool-ocp-schedules-9,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.691 WARN 77632 --- [pool-ocp-schedules-5,20fcfae4f89f49a0,5263d9d7697d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.694 INFO 77632 --- [pool-ocp-async-6,90d110cc8a5e42bb,f2937f9a3d7d] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:02.696 WARN 77632 --- [pool-ocp-schedules-12,a7fdc3b9a40f4a22,6dde29a92d3f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.712 WARN 77632 --- [pool-scanner-12393-1,90d110cc8a5e42bb,e6a84d3c93a6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:02.717 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:02.718 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 779, createErrorCount 39 2024-06-04 10:50:02.719 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [POST /services client=0:0:0:0:0:0:0:1, traceId=a37ec228047e474a, args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469396713876,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},, duration=4003 ms] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 779, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:02.719 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-5,a37ec228047e474a,1a09fdbd8605] c.o.o.s.c.exception.RpcExceptionHandler : Unhandled exception, uri=/services, duration=4004 org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 779, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:02.842 WARN 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.874 INFO 77632 --- [pool-ocp-async-2,e8cf0d7f200b42f7,a95fbab0b198] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:02.891 WARN 77632 --- [pool-ocp-schedules-18,3ecf3c196f48450a,a084ccbe6c1a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.926 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.929 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:02.929 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 990, createErrorCount 39 2024-06-04 10:50:02.929 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:02.931 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:02.931 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 992, createErrorCount 39 2024-06-04 10:50:02.931 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 992, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:02.932 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:02.946 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.002 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.002 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1063, createErrorCount 39 2024-06-04 10:50:03.002 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:03.022 WARN 77632 --- [pool-ocp-async-3,079eabe17aba486d,b8e66fbb8a26] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.022 INFO 77632 --- [pool-ocp-async-1,f18c737267d64702,1fbf387e6ec6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:03.022 WARN 77632 --- [pool-ocp-async-9,c353d217e73948f8,00c8a6a441d7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.022 WARN 77632 --- [pool-ocp-async-10,43351ba552b54319,0269b1892bf3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.022 WARN 77632 --- [pool-ocp-async-8,7b7573cf221d445f,a89761e05968] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.022 ERROR 77632 --- [pool-ocp-async-10,43351ba552b54319,0269b1892bf3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1083, createErrorCount 39 2024-06-04 10:50:03.022 ERROR 77632 --- [pool-ocp-async-8,7b7573cf221d445f,a89761e05968] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1083, createErrorCount 39 2024-06-04 10:50:03.031 WARN 77632 --- [pool-ocp-async-7,34f54c9dde5d4ca1,2c3b69198b02] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.032 WARN 77632 --- [pool-ocp-async-1,f18c737267d64702,1fbf387e6ec6] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:03.157 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.157 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1218, createErrorCount 39 2024-06-04 10:50:03.157 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:03.246 WARN 77632 --- [pool-ocp-schedules-3,2c8c7062d9dc473c,505934fd40da] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.274 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.295 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.295 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1356, createErrorCount 39 2024-06-04 10:50:03.295 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1356, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:03.320 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.611 WARN 77632 --- [pool-ocp-schedules-17,9f640924550f443d,f6661ee5e004] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.611 ERROR 77632 --- [pool-ocp-schedules-17,9f640924550f443d,f6661ee5e004] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1672, createErrorCount 39 2024-06-04 10:50:03.612 ERROR 77632 --- [pool-ocp-schedules-17,9f640924550f443d,f6661ee5e004] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.resolveAlarms(OcpAlarmSearchService.java:531) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.resolveAlarmsOfAbsentTargets(AlarmSchedules.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1672, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:03.749 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.749 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 39 2024-06-04 10:50:03.749 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:03.812 INFO 77632 --- [pool-ocp-schedules-16,3681e84761a345aa,cef9749ce943] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:50:03.905 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:03.905 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1966, createErrorCount 39 2024-06-04 10:50:03.905 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1966, createErrorCount 39 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:03.914 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.933 WARN 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:03.941 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:03.941 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.001 ERROR 77632 --- [pool-ocp-schedules-9,,] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 40 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:968) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1023) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1033) at com.oceanbase.ocp.server.common.config.SpringSessionConfiguration$CustomizedJdbcIndexedSessionRepository.cleanUpExpiredSessions(SpringSessionConfiguration.java:115) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 40 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 14 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.303 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.510 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.511 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.691 WARN 77632 --- [pool-ocp-schedules-5,20fcfae4f89f49a0,5263d9d7697d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:04.691 ERROR 77632 --- [pool-ocp-schedules-5,20fcfae4f89f49a0,5263d9d7697d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 2024-06-04 10:50:04.691 ERROR 77632 --- [pool-ocp-schedules-5,20fcfae4f89f49a0,5263d9d7697d] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.core.notification.NotificationSender.refresh(NotificationSender.java:114) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmInMemtory(AlarmSchedules.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 34 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.695 WARN 77632 --- [alarm-detect-3,90d110cc8a5e42bb,10eb778f3133] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.695 WARN 77632 --- [alarm-detect-24,90d110cc8a5e42bb,055923eb4b0a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.696 WARN 77632 --- [alarm-detect-11,90d110cc8a5e42bb,56094f4a7c19] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.696 WARN 77632 --- [alarm-detect-4,90d110cc8a5e42bb,ef63db311475] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.696 WARN 77632 --- [alarm-detect-9,90d110cc8a5e42bb,432aac893127] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.696 WARN 77632 --- [alarm-detect-5,90d110cc8a5e42bb,d0a85c9ef133] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.696 WARN 77632 --- [pool-ocp-schedules-12,a7fdc3b9a40f4a22,6dde29a92d3f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:04.696 ERROR 77632 --- [pool-ocp-schedules-12,a7fdc3b9a40f4a22,6dde29a92d3f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 2024-06-04 10:50:04.697 ERROR 77632 --- [pool-ocp-schedules-12,a7fdc3b9a40f4a22,6dde29a92d3f] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.refreshActiveAlarmStatus(OcpAlarmSearchService.java:508) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshActiveAlarmStatus(AlarmSchedules.java:89) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 67 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.697 WARN 77632 --- [alarm-detect-25,90d110cc8a5e42bb,13c3e9cab3f6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.697 WARN 77632 --- [alarm-detect-10,90d110cc8a5e42bb,46a2c902ee53] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.697 WARN 77632 --- [alarm-detect-18,90d110cc8a5e42bb,fada994ba668] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.700 WARN 77632 --- [alarm-detect-26,90d110cc8a5e42bb,44ee34ce687f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.700 WARN 77632 --- [alarm-detect-8,90d110cc8a5e42bb,ff10fee0769e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.700 WARN 77632 --- [alarm-detect-20,90d110cc8a5e42bb,bffc19870e2f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.700 WARN 77632 --- [alarm-detect-7,90d110cc8a5e42bb,3ed15bc07125] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.701 WARN 77632 --- [alarm-detect-29,90d110cc8a5e42bb,db0ed897943f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.701 WARN 77632 --- [alarm-detect-19,90d110cc8a5e42bb,8cf610d4d7a2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.706 WARN 77632 --- [alarm-detect-12,90d110cc8a5e42bb,a24e756afebf] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.706 WARN 77632 --- [alarm-detect-2,90d110cc8a5e42bb,bd9bac3dba2a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.706 WARN 77632 --- [alarm-detect-15,90d110cc8a5e42bb,9acd8264ffec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.706 WARN 77632 --- [alarm-detect-17,90d110cc8a5e42bb,23ac47459ab9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.706 WARN 77632 --- [alarm-detect-16,90d110cc8a5e42bb,e007f3b8175e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.708 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.709 WARN 77632 --- [alarm-detect-22,90d110cc8a5e42bb,7fdc195daf48] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.713 WARN 77632 --- [alarm-detect-14,90d110cc8a5e42bb,65633735d9af] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.714 WARN 77632 --- [alarm-detect-27,90d110cc8a5e42bb,7c9ebc280e35] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.736 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.843 WARN 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:04.843 ERROR 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 2024-06-04 10:50:04.846 ERROR 77632 --- [pool-ocp-schedules-2,da379c3bbe4b4a83,2ebccb4c7c37] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy391.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService.listAll(OcpAlarmGroupService.java:209) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService$$FastClassBySpringCGLIB$$44910b7f.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService$$EnhancerBySpringCGLIB$$38a863ae.listAll() at com.oceanbase.ocp.alarm.service.AlarmInMemoryServiceImpl.createAlarm(AlarmInMemoryServiceImpl.java:96) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.createMetaDBAlarmInMemory(HealthCheckService.java:148) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMetaDbHealth(HealthCheckService.java:126) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 38 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 42 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.860 WARN 77632 --- [pool-overview-container-5,d911abbbcf0b48fc,c5a715e680ad] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.860 WARN 77632 --- [pool-overview-container-2,c8f5764ec0b3438b,993749e77ede] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.860 WARN 77632 --- [pool-overview-container-6,8d52678188194dc1,5675640192ff] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.861 WARN 77632 --- [pool-overview-container-1,adea7cb8a0454144,4943d3bf1e0a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.874 WARN 77632 --- [pool-overview-container-3,837b7390f63e44f7,87ceef2febb8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.875 WARN 77632 --- [pool-ocp-async-2,e8cf0d7f200b42f7,a95fbab0b198] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.884 WARN 77632 --- [pool-overview-container-8,d69d7cf2e3704ab6,cc6b03883137] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:04.926 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:04.926 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 2024-06-04 10:50:04.927 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.932 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:04.933 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:04.946 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 41 2024-06-04 10:50:05.022 WARN 77632 --- [pool-ocp-async-4,c58183123edb4668,1dfd527db781] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:05.022 WARN 77632 --- [pool-ocp-async-3,079eabe17aba486d,b8e66fbb8a26] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.022 ERROR 77632 --- [pool-ocp-async-3,079eabe17aba486d,b8e66fbb8a26] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 10, createErrorCount 41 2024-06-04 10:50:05.022 WARN 77632 --- [pool-ocp-async-9,c353d217e73948f8,00c8a6a441d7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.022 ERROR 77632 --- [pool-ocp-async-9,c353d217e73948f8,00c8a6a441d7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 11, createErrorCount 41 2024-06-04 10:50:05.022 INFO 77632 --- [pool-ocp-async-1,f726b428c28e466d,56292fd3993e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:05.022 WARN 77632 --- [pool-ocp-async-10,903ce446b4a54b68,d035d024bd17] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:05.032 WARN 77632 --- [pool-ocp-async-1,f726b428c28e466d,56292fd3993e] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:05.032 WARN 77632 --- [pool-ocp-async-7,34f54c9dde5d4ca1,2c3b69198b02] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.032 ERROR 77632 --- [pool-ocp-async-7,34f54c9dde5d4ca1,2c3b69198b02] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 21, createErrorCount 41 2024-06-04 10:50:05.246 WARN 77632 --- [pool-ocp-schedules-3,2c8c7062d9dc473c,505934fd40da] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.246 ERROR 77632 --- [pool-ocp-schedules-3,2c8c7062d9dc473c,505934fd40da] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 235, createErrorCount 41 2024-06-04 10:50:05.247 ERROR 77632 --- [pool-ocp-schedules-3,2c8c7062d9dc473c,505934fd40da] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at collect-obproxy-metrics at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.lockAndExec(ObproxySchedules.java:34) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.collectObproxyMetrics(ObproxySchedules.java:29) at sun.reflect.GeneratedMethodAccessor502.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 235, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:05.275 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.275 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 263, createErrorCount 41 2024-06-04 10:50:05.275 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:05.321 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.321 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 309, createErrorCount 41 2024-06-04 10:50:05.321 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:05.386 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-06-04 10:50:05.387 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435603667038208 2024-06-04 10:50:05.475 WARN 77632 --- [pool-ocp-schedules-20,09d604e0959043cc,424351667e4f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:05.713 WARN 77632 --- [pool-ocp-async-6,90d110cc8a5e42bb,f2937f9a3d7d] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:50:05.713 WARN 77632 --- [alarm-detect-25,90d110cc8a5e42bb,13c3e9cab3f6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.713 ERROR 77632 --- [alarm-detect-25,90d110cc8a5e42bb,13c3e9cab3f6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.713 WARN 77632 --- [alarm-detect-16,90d110cc8a5e42bb,e007f3b8175e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.713 ERROR 77632 --- [alarm-detect-16,90d110cc8a5e42bb,e007f3b8175e] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.713 WARN 77632 --- [alarm-detect-10,90d110cc8a5e42bb,46a2c902ee53] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.713 ERROR 77632 --- [alarm-detect-10,90d110cc8a5e42bb,46a2c902ee53] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.714 ERROR 77632 --- [alarm-detect-25,90d110cc8a5e42bb,13c3e9cab3f6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=backup_storage_capacity_retry_times_exceeded org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.714 ERROR 77632 --- [alarm-detect-10,90d110cc8a5e42bb,46a2c902ee53] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_recyclebin_disk_used_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.714 WARN 77632 --- [alarm-detect-12,90d110cc8a5e42bb,a24e756afebf] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.714 ERROR 77632 --- [alarm-detect-12,90d110cc8a5e42bb,a24e756afebf] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.714 WARN 77632 --- [alarm-detect-18,90d110cc8a5e42bb,fada994ba668] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.714 ERROR 77632 --- [alarm-detect-18,90d110cc8a5e42bb,fada994ba668] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.715 ERROR 77632 --- [alarm-detect-12,90d110cc8a5e42bb,a24e756afebf] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_net_send_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.715 ERROR 77632 --- [alarm-detect-18,90d110cc8a5e42bb,fada994ba668] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=refresh_location_cache_failed_by_metric org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.715 WARN 77632 --- [alarm-detect-2,90d110cc8a5e42bb,bd9bac3dba2a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.715 ERROR 77632 --- [alarm-detect-2,90d110cc8a5e42bb,bd9bac3dba2a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.715 ERROR 77632 --- [alarm-detect-2,90d110cc8a5e42bb,bd9bac3dba2a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_sda_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.716 WARN 77632 --- [alarm-detect-15,90d110cc8a5e42bb,9acd8264ffec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.716 ERROR 77632 --- [alarm-detect-15,90d110cc8a5e42bb,9acd8264ffec] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.716 ERROR 77632 --- [alarm-detect-15,90d110cc8a5e42bb,9acd8264ffec] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_nvme_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.716 WARN 77632 --- [alarm-detect-17,90d110cc8a5e42bb,23ac47459ab9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.716 ERROR 77632 --- [alarm-detect-17,90d110cc8a5e42bb,23ac47459ab9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.716 WARN 77632 --- [alarm-detect-3,90d110cc8a5e42bb,10eb778f3133] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.716 ERROR 77632 --- [alarm-detect-3,90d110cc8a5e42bb,10eb778f3133] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.717 ERROR 77632 --- [alarm-detect-17,90d110cc8a5e42bb,23ac47459ab9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ic_server_connect_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.717 ERROR 77632 --- [alarm-detect-3,90d110cc8a5e42bb,10eb778f3133] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_cannot_connect_arbitration org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.714 ERROR 77632 --- [alarm-detect-16,90d110cc8a5e42bb,e007f3b8175e] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_cannot_connect_to_leader org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.718 WARN 77632 --- [alarm-detect-24,90d110cc8a5e42bb,055923eb4b0a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.718 ERROR 77632 --- [alarm-detect-24,90d110cc8a5e42bb,055923eb4b0a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.718 ERROR 77632 --- [alarm-detect-24,90d110cc8a5e42bb,055923eb4b0a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_partition_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.719 WARN 77632 --- [alarm-detect-11,90d110cc8a5e42bb,56094f4a7c19] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.719 ERROR 77632 --- [alarm-detect-11,90d110cc8a5e42bb,56094f4a7c19] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.719 ERROR 77632 --- [alarm-detect-11,90d110cc8a5e42bb,56094f4a7c19] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.719 WARN 77632 --- [alarm-detect-4,90d110cc8a5e42bb,ef63db311475] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.720 ERROR 77632 --- [alarm-detect-4,90d110cc8a5e42bb,ef63db311475] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.720 ERROR 77632 --- [alarm-detect-4,90d110cc8a5e42bb,ef63db311475] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_log_disk_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.720 WARN 77632 --- [alarm-detect-9,90d110cc8a5e42bb,432aac893127] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.720 ERROR 77632 --- [alarm-detect-9,90d110cc8a5e42bb,432aac893127] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.721 ERROR 77632 --- [alarm-detect-9,90d110cc8a5e42bb,432aac893127] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_hwm org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.721 WARN 77632 --- [alarm-detect-5,90d110cc8a5e42bb,d0a85c9ef133] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.721 ERROR 77632 --- [alarm-detect-5,90d110cc8a5e42bb,d0a85c9ef133] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.722 ERROR 77632 --- [alarm-detect-5,90d110cc8a5e42bb,d0a85c9ef133] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxy_cannot_connected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.722 WARN 77632 --- [alarm-detect-26,90d110cc8a5e42bb,44ee34ce687f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.722 ERROR 77632 --- [alarm-detect-26,90d110cc8a5e42bb,44ee34ce687f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.723 ERROR 77632 --- [alarm-detect-26,90d110cc8a5e42bb,44ee34ce687f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_sync_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.723 WARN 77632 --- [alarm-detect-14,90d110cc8a5e42bb,65633735d9af] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.723 ERROR 77632 --- [alarm-detect-14,90d110cc8a5e42bb,65633735d9af] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.723 ERROR 77632 --- [alarm-detect-14,90d110cc8a5e42bb,65633735d9af] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.724 WARN 77632 --- [alarm-detect-8,90d110cc8a5e42bb,ff10fee0769e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.724 ERROR 77632 --- [alarm-detect-8,90d110cc8a5e42bb,ff10fee0769e] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.724 ERROR 77632 --- [alarm-detect-8,90d110cc8a5e42bb,ff10fee0769e] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.725 WARN 77632 --- [alarm-detect-20,90d110cc8a5e42bb,bffc19870e2f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.725 ERROR 77632 --- [alarm-detect-20,90d110cc8a5e42bb,bffc19870e2f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.725 ERROR 77632 --- [alarm-detect-20,90d110cc8a5e42bb,bffc19870e2f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.725 WARN 77632 --- [alarm-detect-27,90d110cc8a5e42bb,7c9ebc280e35] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.725 ERROR 77632 --- [alarm-detect-27,90d110cc8a5e42bb,7c9ebc280e35] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.726 ERROR 77632 --- [alarm-detect-27,90d110cc8a5e42bb,7c9ebc280e35] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_nic_usage_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.726 WARN 77632 --- [alarm-detect-7,90d110cc8a5e42bb,3ed15bc07125] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.726 ERROR 77632 --- [alarm-detect-7,90d110cc8a5e42bb,3ed15bc07125] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.727 ERROR 77632 --- [alarm-detect-7,90d110cc8a5e42bb,3ed15bc07125] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=arbitration_service_unavailable org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.727 WARN 77632 --- [alarm-detect-29,90d110cc8a5e42bb,db0ed897943f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.727 ERROR 77632 --- [alarm-detect-29,90d110cc8a5e42bb,db0ed897943f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.728 ERROR 77632 --- [alarm-detect-29,90d110cc8a5e42bb,db0ed897943f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_active_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.728 WARN 77632 --- [alarm-detect-19,90d110cc8a5e42bb,8cf610d4d7a2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.728 ERROR 77632 --- [alarm-detect-19,90d110cc8a5e42bb,8cf610d4d7a2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.728 WARN 77632 --- [alarm-detect-22,90d110cc8a5e42bb,7fdc195daf48] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.728 ERROR 77632 --- [alarm-detect-22,90d110cc8a5e42bb,7fdc195daf48] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:05.728 ERROR 77632 --- [alarm-detect-22,90d110cc8a5e42bb,7fdc195daf48] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_ip_forward_invalid org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.728 ERROR 77632 --- [alarm-detect-19,90d110cc8a5e42bb,8cf610d4d7a2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obagent_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:05.813 WARN 77632 --- [pool-ocp-schedules-16,3681e84761a345aa,cef9749ce943] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:05.914 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.914 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 902, createErrorCount 41 2024-06-04 10:50:05.914 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 902, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:05.929 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:05.934 WARN 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:05.934 ERROR 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 922, createErrorCount 41 2024-06-04 10:50:05.934 ERROR 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 922, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:05.934 INFO 77632 --- [pool-prometheus-minute-schedule-1,c1a1a54ba0f34d89,f8755a5546ec] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469401933, count=0, elapsed=4001 2024-06-04 10:50:05.934 INFO 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:06.002 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:06.157 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:06.296 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:06.303 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1292, createErrorCount 41 2024-06-04 10:50:06.709 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.709 ERROR 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1697, createErrorCount 41 2024-06-04 10:50:06.709 ERROR 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy339.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterSnapshots(RecordingRuleLabelMatchContainer.java:219) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:75) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1697, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.737 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.737 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1725, createErrorCount 41 2024-06-04 10:50:06.737 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:06.749 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:06.861 WARN 77632 --- [pool-overview-container-5,d911abbbcf0b48fc,c5a715e680ad] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.861 ERROR 77632 --- [pool-overview-container-5,d911abbbcf0b48fc,c5a715e680ad] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 2024-06-04 10:50:06.861 WARN 77632 --- [pool-overview-container-6,8d52678188194dc1,5675640192ff] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.861 ERROR 77632 --- [pool-overview-container-6,8d52678188194dc1,5675640192ff] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 2024-06-04 10:50:06.861 ERROR 77632 --- [pool-overview-container-5,d911abbbcf0b48fc,c5a715e680ad] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.861 ERROR 77632 --- [pool-overview-container-6,8d52678188194dc1,5675640192ff] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.861 WARN 77632 --- [pool-overview-container-5,d911abbbcf0b48fc,c5a715e680ad] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.861 WARN 77632 --- [pool-overview-container-6,8d52678188194dc1,5675640192ff] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.861 WARN 77632 --- [pool-overview-container-2,c8f5764ec0b3438b,993749e77ede] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.862 ERROR 77632 --- [pool-overview-container-2,c8f5764ec0b3438b,993749e77ede] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1850, createErrorCount 41 2024-06-04 10:50:06.862 ERROR 77632 --- [pool-overview-container-2,c8f5764ec0b3438b,993749e77ede] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1850, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.862 WARN 77632 --- [pool-overview-container-2,c8f5764ec0b3438b,993749e77ede] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1850, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.862 WARN 77632 --- [pool-overview-container-1,adea7cb8a0454144,4943d3bf1e0a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.862 ERROR 77632 --- [pool-overview-container-1,adea7cb8a0454144,4943d3bf1e0a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1851, createErrorCount 41 2024-06-04 10:50:06.863 ERROR 77632 --- [pool-overview-container-1,adea7cb8a0454144,4943d3bf1e0a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1851, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.863 WARN 77632 --- [pool-overview-container-1,adea7cb8a0454144,4943d3bf1e0a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1851, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.875 WARN 77632 --- [pool-overview-container-3,837b7390f63e44f7,87ceef2febb8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.875 ERROR 77632 --- [pool-overview-container-3,837b7390f63e44f7,87ceef2febb8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1863, createErrorCount 41 2024-06-04 10:50:06.875 WARN 77632 --- [pool-ocp-async-2,e8cf0d7f200b42f7,a95fbab0b198] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.875 ERROR 77632 --- [pool-ocp-async-2,e8cf0d7f200b42f7,a95fbab0b198] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1863, createErrorCount 41 2024-06-04 10:50:06.875 ERROR 77632 --- [pool-overview-container-3,837b7390f63e44f7,87ceef2febb8] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1863, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.875 WARN 77632 --- [pool-overview-container-3,837b7390f63e44f7,87ceef2febb8] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1863, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.884 WARN 77632 --- [pool-overview-container-8,d69d7cf2e3704ab6,cc6b03883137] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:06.885 ERROR 77632 --- [pool-overview-container-8,d69d7cf2e3704ab6,cc6b03883137] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1873, createErrorCount 41 2024-06-04 10:50:06.885 ERROR 77632 --- [pool-overview-container-8,d69d7cf2e3704ab6,cc6b03883137] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1873, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.885 WARN 77632 --- [pool-overview-container-8,d69d7cf2e3704ab6,cc6b03883137] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1873, createErrorCount 41 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:06.947 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.013 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.016 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.022 INFO 77632 --- [pool-ocp-async-6,3883786b8fee4671,51bf99e9da03] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:07.022 WARN 77632 --- [pool-ocp-async-4,c58183123edb4668,1dfd527db781] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:07.022 ERROR 77632 --- [pool-ocp-async-4,c58183123edb4668,1dfd527db781] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 42 2024-06-04 10:50:07.022 WARN 77632 --- [pool-ocp-async-8,f18df6196d924760,f918d5f00f6c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.022 WARN 77632 --- [pool-ocp-async-3,3af83f3811364b4e,85ba62fc3481] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.022 WARN 77632 --- [pool-ocp-async-10,903ce446b4a54b68,d035d024bd17] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:07.022 ERROR 77632 --- [pool-ocp-async-10,903ce446b4a54b68,d035d024bd17] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 42 2024-06-04 10:50:07.387 WARN 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.475 WARN 77632 --- [pool-ocp-schedules-20,09d604e0959043cc,424351667e4f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:07.475 ERROR 77632 --- [pool-ocp-schedules-20,09d604e0959043cc,424351667e4f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 42 2024-06-04 10:50:07.476 ERROR 77632 --- [pool-ocp-schedules-20,09d604e0959043cc,424351667e4f] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 42 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.581 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.581 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.588 WARN 77632 --- [pool-ocp-schedules-2,b4b0e9dcab104acc,58eadd6ffe12] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.813 WARN 77632 --- [pool-ocp-schedules-16,3681e84761a345aa,cef9749ce943] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:07.813 ERROR 77632 --- [pool-ocp-schedules-16,3681e84761a345aa,cef9749ce943] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 43 2024-06-04 10:50:07.813 ERROR 77632 --- [pool-ocp-schedules-16,3681e84761a345aa,cef9749ce943] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:07.929 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:07.929 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 43 2024-06-04 10:50:07.929 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:07.932 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:07.934 WARN 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:08.002 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:08.002 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 43 2024-06-04 10:50:08.002 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:08.157 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:08.157 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 75, createErrorCount 43 2024-06-04 10:50:08.157 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:08.296 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:08.296 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 214, createErrorCount 43 2024-06-04 10:50:08.296 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 214, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:08.703 WARN 77632 --- [pool-ocp-schedules-6,e954d873b7974888,4409f09ee084] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:08.711 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:08.750 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:08.750 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 668, createErrorCount 43 2024-06-04 10:50:08.754 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 668, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:08.906 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:08.947 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 865, createErrorCount 43 2024-06-04 10:50:09.022 WARN 77632 --- [pool-ocp-async-7,4c29234504a542f5,baa6ca5969d3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:09.022 WARN 77632 --- [pool-ocp-async-6,3883786b8fee4671,51bf99e9da03] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:09.022 INFO 77632 --- [pool-ocp-async-1,da339f17aff14adb,2b67737470d2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:09.022 WARN 77632 --- [pool-ocp-async-2,762eec5da2ca4c3d,e1d4107fc0bd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:09.022 WARN 77632 --- [pool-ocp-async-8,f18df6196d924760,f918d5f00f6c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:09.022 ERROR 77632 --- [pool-ocp-async-8,f18df6196d924760,f918d5f00f6c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 940, createErrorCount 43 2024-06-04 10:50:09.022 WARN 77632 --- [pool-ocp-async-3,3af83f3811364b4e,85ba62fc3481] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:09.022 ERROR 77632 --- [pool-ocp-async-3,3af83f3811364b4e,85ba62fc3481] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 940, createErrorCount 43 2024-06-04 10:50:09.032 WARN 77632 --- [pool-ocp-async-1,da339f17aff14adb,2b67737470d2] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:09.387 ERROR 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1305, createErrorCount 37 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.fetchAfterId(SeriesKeyIdPersistent.java:84) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.fetchAfterId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.fetchAfterId(SeriesIdKeyService.java:101) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1305, createErrorCount 37 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:09.387 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-06-04 10:50:09.387 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435041944875008 2024-06-04 10:50:09.588 WARN 77632 --- [pool-ocp-schedules-2,b4b0e9dcab104acc,58eadd6ffe12] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:09.589 ERROR 77632 --- [pool-ocp-schedules-2,b4b0e9dcab104acc,58eadd6ffe12] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1507, createErrorCount 43 2024-06-04 10:50:09.589 ERROR 77632 --- [pool-ocp-schedules-2,b4b0e9dcab104acc,58eadd6ffe12] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1507, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:09.927 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:09.932 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:09.932 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1850, createErrorCount 43 2024-06-04 10:50:09.932 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1850, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:09.933 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:09.935 WARN 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:09.935 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1853, createErrorCount 43 2024-06-04 10:50:09.935 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1853, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:09.935 INFO 77632 --- [pool-prometheus-minute-schedule-1,f8836ff9de6943d9,d9ec19b51b75] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469405934, count=0, elapsed=4001 2024-06-04 10:50:09.935 INFO 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:10.003 INFO 77632 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Follower checked 2024-06-04 10:50:10.083 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.083 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.655 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.655 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.703 WARN 77632 --- [pool-ocp-schedules-6,e954d873b7974888,4409f09ee084] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:10.704 ERROR 77632 --- [pool-ocp-schedules-6,e954d873b7974888,4409f09ee084] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:10.704 ERROR 77632 --- [pool-ocp-schedules-6,e954d873b7974888,4409f09ee084] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.711 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:10.711 ERROR 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:10.711 ERROR 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterTenantSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy364.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterTenantSnapshots(RecordingRuleLabelMatchContainer.java:248) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:76) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.906 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:10.906 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:10.907 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:10.915 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:10.930 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:10.947 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.003 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.022 WARN 77632 --- [pool-ocp-async-9,1a51e5478d7c48f5,0edb20e85681] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.022 INFO 77632 --- [pool-ocp-async-1,2db9e9215fa24e47,ab560d4c5c7b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:11.022 WARN 77632 --- [pool-ocp-async-7,4c29234504a542f5,baa6ca5969d3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:11.022 ERROR 77632 --- [pool-ocp-async-7,4c29234504a542f5,baa6ca5969d3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:11.022 WARN 77632 --- [pool-ocp-async-6,3883786b8fee4671,51bf99e9da03] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:11.022 ERROR 77632 --- [pool-ocp-async-6,3883786b8fee4671,51bf99e9da03] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:11.022 WARN 77632 --- [pool-ocp-async-2,762eec5da2ca4c3d,e1d4107fc0bd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:11.022 ERROR 77632 --- [pool-ocp-async-2,762eec5da2ca4c3d,e1d4107fc0bd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 45 2024-06-04 10:50:11.022 WARN 77632 --- [pool-ocp-async-10,94a9a5d268e5462a,b75c1fc450e0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.158 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.297 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.388 WARN 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.754 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:11.928 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:11.928 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 771, createErrorCount 45 2024-06-04 10:50:11.928 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 771, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:11.933 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 777, createErrorCount 45 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 777, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:11.933 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:11.935 WARN 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:12.275 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:12.321 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:12.658 ERROR 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:50:12.658 INFO 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-06-04 10:50:12.659 ERROR 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:50:12.659 WARN 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : no ready nodes for cache. startTime = 1717469280 2024-06-04 10:50:12.659 INFO 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-06-04 10:50:12.694 INFO 77632 --- [pool-ocp-async-6,dbc78a652a80443f,85c6841a841c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:12.711 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:12.731 WARN 77632 --- [pool-scanner-12413-1,dbc78a652a80443f,81399bc07012] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:12.874 INFO 77632 --- [pool-ocp-async-4,5e9f50cdd21342da,4f3964272096] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:12.915 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:12.916 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1759, createErrorCount 45 2024-06-04 10:50:12.916 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1759, createErrorCount 45 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:12.930 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:12.930 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1774, createErrorCount 45 2024-06-04 10:50:12.930 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:12.947 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1791, createErrorCount 45 2024-06-04 10:50:13.003 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.003 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1846, createErrorCount 45 2024-06-04 10:50:13.003 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:13.022 INFO 77632 --- [pool-ocp-async-3,84767b66d0254e95,82c3f19538b4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:13.022 WARN 77632 --- [pool-ocp-async-9,1a51e5478d7c48f5,0edb20e85681] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.022 ERROR 77632 --- [pool-ocp-async-9,1a51e5478d7c48f5,0edb20e85681] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1866, createErrorCount 45 2024-06-04 10:50:13.022 WARN 77632 --- [pool-ocp-async-7,cf9171ce2d824ae9,7c5a956d1467] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:13.022 WARN 77632 --- [pool-ocp-async-1,2db9e9215fa24e47,ab560d4c5c7b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:13.022 WARN 77632 --- [pool-ocp-async-8,27a47b0ce5d34a71,d7481d7b5c17] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:13.023 WARN 77632 --- [pool-ocp-async-10,94a9a5d268e5462a,b75c1fc450e0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.023 ERROR 77632 --- [pool-ocp-async-10,94a9a5d268e5462a,b75c1fc450e0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1866, createErrorCount 45 2024-06-04 10:50:13.033 WARN 77632 --- [pool-ocp-async-3,84767b66d0254e95,82c3f19538b4] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:13.158 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.159 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.159 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 46 2024-06-04 10:50:13.159 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:13.159 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.297 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.297 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 46 2024-06-04 10:50:13.297 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 46 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.388 ERROR 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 40 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent.fetchAfterId(MeasurementIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$FastClassBySpringCGLIB$$278002a9.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$EnhancerBySpringCGLIB$$1eefe4e.fetchAfterId() at com.oceanbase.ocp.monitor.service.MeasurementIdService.fetchAfterId(MeasurementIdService.java:32) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 40 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.388 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-06-04 10:50:13.388 INFO 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435043945558016 2024-06-04 10:50:13.725 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.725 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.737 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:13.755 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.755 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 47 2024-06-04 10:50:13.755 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 47 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.915 WARN 77632 --- [pool-prometheus-exporter-check1,931ce41525ff4f0f,569e1750fd3c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:13.936 WARN 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:13.936 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 47 2024-06-04 10:50:13.936 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 47 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:13.936 INFO 77632 --- [pool-prometheus-minute-schedule-1,4bbb8517543b4134,fa0900b2e9e9] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469409935, count=0, elapsed=4001 2024-06-04 10:50:13.936 INFO 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:14.275 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:14.276 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 49, createErrorCount 47 2024-06-04 10:50:14.276 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:14.321 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:14.321 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 95, createErrorCount 47 2024-06-04 10:50:14.321 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:14.712 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:14.712 ERROR 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 486, createErrorCount 47 2024-06-04 10:50:14.712 WARN 77632 --- [pool-ocp-async-5,d7f24216c4ab4978,6f9e00badca2] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshObProxySnapshots(RecordingRuleLabelMatchContainer.java:269) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:77) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 486, createErrorCount 47 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:14.861 WARN 77632 --- [pool-overview-container-5,e27da192feb6416e,3c04b4d05688] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.861 WARN 77632 --- [pool-overview-container-7,02c7219dbb364bb9,15a754356497] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.861 WARN 77632 --- [pool-overview-container-6,3107b04866d74ee3,b6fed659332c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.861 WARN 77632 --- [pool-overview-container-4,f5439208a1924598,c6ddbbf3be48] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.874 WARN 77632 --- [pool-overview-container-2,ccff2fa35ae94842,78b4c5e8de35] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.875 WARN 77632 --- [pool-ocp-async-4,5e9f50cdd21342da,4f3964272096] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.884 WARN 77632 --- [pool-overview-container-1,679df722b7894d6d,1bc95b7745e3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.933 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:14.947 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.023 WARN 77632 --- [pool-ocp-async-7,cf9171ce2d824ae9,7c5a956d1467] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:15.023 WARN 77632 --- [pool-ocp-async-1,2db9e9215fa24e47,ab560d4c5c7b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:15.023 ERROR 77632 --- [pool-ocp-async-1,2db9e9215fa24e47,ab560d4c5c7b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 797, createErrorCount 47 2024-06-04 10:50:15.023 INFO 77632 --- [pool-ocp-async-9,43786df1a9fe4d0a,0d7dbd5ae33b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:15.023 ERROR 77632 --- [pool-ocp-async-7,cf9171ce2d824ae9,7c5a956d1467] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 797, createErrorCount 47 2024-06-04 10:50:15.023 WARN 77632 --- [pool-ocp-async-6,4ec321610c064dce,22c404ffc323] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.023 WARN 77632 --- [pool-ocp-async-2,978a60c5a0ed4a82,277e82375fb2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.023 WARN 77632 --- [pool-ocp-async-8,27a47b0ce5d34a71,d7481d7b5c17] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:15.023 ERROR 77632 --- [pool-ocp-async-8,27a47b0ce5d34a71,d7481d7b5c17] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 797, createErrorCount 47 2024-06-04 10:50:15.388 WARN 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.737 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:15.737 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1511, createErrorCount 47 2024-06-04 10:50:15.737 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:15.907 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.916 WARN 77632 --- [pool-prometheus-exporter-check1,931ce41525ff4f0f,569e1750fd3c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,931ce41525ff4f0f,569e1750fd3c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1690, createErrorCount 47 2024-06-04 10:50:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,931ce41525ff4f0f,569e1750fd3c] c.o.ocp.monitor.OcpMonitorManager : checkActiveExporters failed: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.getAllExporterIdsWithSwitchOn(OcpExporterServiceImpl.java:178) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkActive(OcpExporterStatusCheckServiceImpl.java:87) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$3(OcpMonitorManager.java:144) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1690, createErrorCount 47 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:15.930 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:15.936 WARN 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.003 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.109 INFO 77632 --- [pool-metric-parse-9,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469415, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:50:16.159 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.227 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.227 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.298 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.756 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.797 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.797 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.861 WARN 77632 --- [pool-overview-container-7,02c7219dbb364bb9,15a754356497] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.861 WARN 77632 --- [pool-overview-container-6,3107b04866d74ee3,b6fed659332c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-7,02c7219dbb364bb9,15a754356497] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-6,3107b04866d74ee3,b6fed659332c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.861 WARN 77632 --- [pool-overview-container-5,e27da192feb6416e,3c04b4d05688] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-5,e27da192feb6416e,3c04b4d05688] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-5,e27da192feb6416e,3c04b4d05688] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-7,02c7219dbb364bb9,15a754356497] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.861 ERROR 77632 --- [pool-overview-container-6,3107b04866d74ee3,b6fed659332c] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.862 WARN 77632 --- [pool-overview-container-5,e27da192feb6416e,3c04b4d05688] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.862 WARN 77632 --- [pool-overview-container-7,02c7219dbb364bb9,15a754356497] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.862 WARN 77632 --- [pool-overview-container-6,3107b04866d74ee3,b6fed659332c] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.862 WARN 77632 --- [pool-overview-container-4,f5439208a1924598,c6ddbbf3be48] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.862 ERROR 77632 --- [pool-overview-container-4,f5439208a1924598,c6ddbbf3be48] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.862 ERROR 77632 --- [pool-overview-container-4,f5439208a1924598,c6ddbbf3be48] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.862 WARN 77632 --- [pool-overview-container-4,f5439208a1924598,c6ddbbf3be48] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.875 WARN 77632 --- [pool-overview-container-2,ccff2fa35ae94842,78b4c5e8de35] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.875 WARN 77632 --- [pool-ocp-async-4,5e9f50cdd21342da,4f3964272096] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.875 ERROR 77632 --- [pool-overview-container-2,ccff2fa35ae94842,78b4c5e8de35] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.875 ERROR 77632 --- [pool-ocp-async-4,5e9f50cdd21342da,4f3964272096] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.875 ERROR 77632 --- [pool-overview-container-2,ccff2fa35ae94842,78b4c5e8de35] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.876 WARN 77632 --- [pool-overview-container-2,ccff2fa35ae94842,78b4c5e8de35] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.885 WARN 77632 --- [pool-overview-container-1,679df722b7894d6d,1bc95b7745e3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.885 ERROR 77632 --- [pool-overview-container-1,679df722b7894d6d,1bc95b7745e3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.885 ERROR 77632 --- [pool-overview-container-1,679df722b7894d6d,1bc95b7745e3] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.885 WARN 77632 --- [pool-overview-container-1,679df722b7894d6d,1bc95b7745e3] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.929 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.933 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:16.933 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:16.934 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:16.934 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:16.948 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:17.022 INFO 77632 --- [pool-ocp-async-1,132623287325441f,44503e3f49cb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:17.022 WARN 77632 --- [pool-ocp-async-5,833035cedf8a4a4c,115fe307f147] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:17.023 WARN 77632 --- [pool-ocp-async-3,5ec7a5fda6cd4f73,3791f35029c2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:17.023 WARN 77632 --- [pool-ocp-async-6,4ec321610c064dce,22c404ffc323] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:17.023 ERROR 77632 --- [pool-ocp-async-6,4ec321610c064dce,22c404ffc323] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:17.023 WARN 77632 --- [pool-ocp-async-2,978a60c5a0ed4a82,277e82375fb2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:17.023 ERROR 77632 --- [pool-ocp-async-2,978a60c5a0ed4a82,277e82375fb2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 49 2024-06-04 10:50:17.026 WARN 77632 --- [pool-ocp-async-9,43786df1a9fe4d0a,0d7dbd5ae33b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:17.033 WARN 77632 --- [pool-ocp-async-1,132623287325441f,44503e3f49cb] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:17.389 ERROR 77632 --- [pool-ocp-schedules-11,0ad77d15064146e0,f6778bca5eef] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 91, createErrorCount 43 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent.fetchAfterId(RecordKeyIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$FastClassBySpringCGLIB$$c73c5afb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$EnhancerBySpringCGLIB$$556cca84.fetchAfterId() at com.oceanbase.ocp.monitor.service.RecordIdKeyService.fetchAfterId(RecordIdKeyService.java:113) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 91, createErrorCount 43 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:17.814 INFO 77632 --- [pool-ocp-schedules-18,8ab0f858d84d4229,d2bbb9a3d45c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:50:17.908 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:17.908 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 610, createErrorCount 49 2024-06-04 10:50:17.908 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 610, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:17.917 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:17.930 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:17.931 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 633, createErrorCount 49 2024-06-04 10:50:17.931 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:17.937 WARN 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:17.937 ERROR 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 639, createErrorCount 49 2024-06-04 10:50:17.937 ERROR 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 639, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:17.937 INFO 77632 --- [pool-prometheus-minute-schedule-1,67f20ebc4acf4e90,7239fc81c25e] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469413936, count=0, elapsed=4001 2024-06-04 10:50:17.937 INFO 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:18.003 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:18.004 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 706, createErrorCount 49 2024-06-04 10:50:18.004 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:18.159 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:18.159 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 861, createErrorCount 49 2024-06-04 10:50:18.159 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:18.298 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:18.298 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1000, createErrorCount 49 2024-06-04 10:50:18.298 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1000, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:18.303 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:18.756 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:18.756 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1458, createErrorCount 49 2024-06-04 10:50:18.756 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1458, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:18.918 WARN 77632 --- [pool-prometheus-exporter-check2,4c3b816e90d74c58,b74c63051b2c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:18.929 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:18.929 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1631, createErrorCount 49 2024-06-04 10:50:18.929 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1631, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:18.935 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1637, createErrorCount 49 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1637, createErrorCount 49 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:18.935 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:18.948 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:19.023 INFO 77632 --- [pool-ocp-async-6,310d85ac82b34c05,4c45898f571d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:19.023 WARN 77632 --- [pool-ocp-async-7,b3f0ff88f48f499a,b5a2d2bb7cda] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:19.023 WARN 77632 --- [pool-ocp-async-10,5d15a8e4954a4487,29052351e2d8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:19.023 WARN 77632 --- [pool-ocp-async-5,833035cedf8a4a4c,115fe307f147] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:19.023 ERROR 77632 --- [pool-ocp-async-5,833035cedf8a4a4c,115fe307f147] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1725, createErrorCount 49 2024-06-04 10:50:19.023 WARN 77632 --- [pool-ocp-async-3,5ec7a5fda6cd4f73,3791f35029c2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:19.023 ERROR 77632 --- [pool-ocp-async-3,5ec7a5fda6cd4f73,3791f35029c2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1725, createErrorCount 49 2024-06-04 10:50:19.026 WARN 77632 --- [pool-ocp-async-9,43786df1a9fe4d0a,0d7dbd5ae33b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:19.026 ERROR 77632 --- [pool-ocp-async-9,43786df1a9fe4d0a,0d7dbd5ae33b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1728, createErrorCount 49 2024-06-04 10:50:19.299 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:19.299 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:19.476 WARN 77632 --- [pool-ocp-schedules-5,a104910fd54c46a3,c7d4dc6ed3bb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:19.814 WARN 77632 --- [pool-ocp-schedules-18,8ab0f858d84d4229,d2bbb9a3d45c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:19.869 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:19.869 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:19.917 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:19.917 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 51 2024-06-04 10:50:19.917 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 51 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:19.938 WARN 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:20.303 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 51 2024-06-04 10:50:20.725 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:20.918 WARN 77632 --- [pool-prometheus-exporter-check2,4c3b816e90d74c58,b74c63051b2c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,4c3b816e90d74c58,b74c63051b2c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 548, createErrorCount 51 2024-06-04 10:50:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,4c3b816e90d74c58,b74c63051b2c] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 548, createErrorCount 51 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 27 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:20.931 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:20.948 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 578, createErrorCount 51 2024-06-04 10:50:21.004 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.023 WARN 77632 --- [pool-ocp-async-4,5564b4ff0d124892,dcc9d5dd25ec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.023 WARN 77632 --- [pool-ocp-async-7,b3f0ff88f48f499a,b5a2d2bb7cda] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:21.023 ERROR 77632 --- [pool-ocp-async-7,b3f0ff88f48f499a,b5a2d2bb7cda] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 653, createErrorCount 51 2024-06-04 10:50:21.023 INFO 77632 --- [pool-ocp-async-1,1e25743530d34622,516e1edd6b5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:21.024 WARN 77632 --- [pool-ocp-async-8,4b0c0c05b4d24f0e,6fad1a5c6c62] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.024 WARN 77632 --- [pool-ocp-async-10,5d15a8e4954a4487,29052351e2d8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:21.024 ERROR 77632 --- [pool-ocp-async-10,5d15a8e4954a4487,29052351e2d8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 654, createErrorCount 51 2024-06-04 10:50:21.026 WARN 77632 --- [pool-ocp-async-6,310d85ac82b34c05,4c45898f571d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.034 WARN 77632 --- [pool-ocp-async-1,1e25743530d34622,516e1edd6b5d] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:21.160 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.277 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.299 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.322 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.476 WARN 77632 --- [pool-ocp-schedules-5,a104910fd54c46a3,c7d4dc6ed3bb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:21.476 ERROR 77632 --- [pool-ocp-schedules-5,a104910fd54c46a3,c7d4dc6ed3bb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1106, createErrorCount 51 2024-06-04 10:50:21.477 ERROR 77632 --- [pool-ocp-schedules-5,a104910fd54c46a3,c7d4dc6ed3bb] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1106, createErrorCount 51 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:21.757 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.814 WARN 77632 --- [pool-ocp-schedules-18,8ab0f858d84d4229,d2bbb9a3d45c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:21.814 ERROR 77632 --- [pool-ocp-schedules-18,8ab0f858d84d4229,d2bbb9a3d45c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1444, createErrorCount 51 2024-06-04 10:50:21.815 ERROR 77632 --- [pool-ocp-schedules-18,8ab0f858d84d4229,d2bbb9a3d45c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1444, createErrorCount 51 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:21.934 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:21.938 WARN 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:21.938 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1568, createErrorCount 51 2024-06-04 10:50:21.938 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1568, createErrorCount 51 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:21.938 INFO 77632 --- [pool-prometheus-minute-schedule-1,3434cd0af2a44034,db5bdeb76d9d] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469417937, count=0, elapsed=4001 2024-06-04 10:50:21.938 INFO 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:22.372 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:22.372 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:22.695 INFO 77632 --- [pool-ocp-async-5,3289323b7b9f48d8,097b8251dfac] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:22.705 WARN 77632 --- [pool-ocp-schedules-7,1514a0ae59f04c08,6d0deb42e174] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:22.710 WARN 77632 --- [pool-scanner-12432-1,3289323b7b9f48d8,1f57b1fc8a5a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:22.726 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] c.o.o.s.c.m.InnerExporterServiceImpl : Failed to collect ocp self-metrics org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 46 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:818) at org.springframework.jdbc.core.JdbcTemplate.queryForList(JdbcTemplate.java:935) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.querySeriesId(SeriesKeyIdPersistent.java:44) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.querySeriesId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.queryAndStoreToCache(SeriesIdKeyService.java:106) at com.oceanbase.ocp.monitor.service.IdKeyService.getId(IdKeyService.java:68) at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.getSeriesId(SeriesIdKeyService.java:89) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.mapMetricLines(RollupMetricDataStore.java:105) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.store(RollupMetricDataStore.java:86) at com.oceanbase.ocp.server.common.metrics.InnerExporterServiceImpl.collect(InnerExporterServiceImpl.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 46 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:22.747 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:22.874 INFO 77632 --- [pool-ocp-async-3,c5d6db33ac3d4fa8,559907b27dfa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:22.909 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:22.909 INFO 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717470000, interval=3600 2024-06-04 10:50:22.931 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:22.931 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 58, createErrorCount 52 2024-06-04 10:50:22.931 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:22.941 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:22.941 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:22.949 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:23.004 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.004 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.004 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:23.023 WARN 77632 --- [pool-ocp-async-2,53741818211a46a5,8f46312b0907] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:23.023 WARN 77632 --- [pool-ocp-async-4,5564b4ff0d124892,dcc9d5dd25ec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.023 ERROR 77632 --- [pool-ocp-async-4,5564b4ff0d124892,dcc9d5dd25ec] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.023 INFO 77632 --- [pool-ocp-async-9,f720a14aa1524b2c,4f49347a2c9a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:23.023 WARN 77632 --- [pool-ocp-async-7,4757f9c459af4106,4b28c28cfb7f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:23.024 WARN 77632 --- [pool-ocp-async-8,4b0c0c05b4d24f0e,6fad1a5c6c62] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.024 ERROR 77632 --- [pool-ocp-async-8,4b0c0c05b4d24f0e,6fad1a5c6c62] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.026 WARN 77632 --- [pool-ocp-async-6,310d85ac82b34c05,4c45898f571d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.027 ERROR 77632 --- [pool-ocp-async-6,310d85ac82b34c05,4c45898f571d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.161 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.161 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.161 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:23.278 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.278 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.278 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:23.300 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.300 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.300 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:23.322 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.322 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 53 2024-06-04 10:50:23.322 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:23.757 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.757 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 315, createErrorCount 53 2024-06-04 10:50:23.757 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 315, createErrorCount 53 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:23.930 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:23.935 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:23.935 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 493, createErrorCount 53 2024-06-04 10:50:23.935 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 493, createErrorCount 53 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:23.935 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:23.938 WARN 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.687 WARN 77632 --- [pool-ocp-schedules-2,05881aa7280d4ed3,4c897fe44662] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.688 WARN 77632 --- [pool-ocp-schedules-12,1bc9ae75d607455e,e225a40bfc05] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.689 WARN 77632 --- [pool-ocp-schedules-18,357889975e6b4b42,b5d1b64ad881] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.691 WARN 77632 --- [pool-ocp-schedules-3,3e17b27d035e4720,9f7a6b32b3dc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.691 WARN 77632 --- [pool-ocp-schedules-19,98fd5467ac224fd6,f3f5c0eed6c5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.691 WARN 77632 --- [pool-ocp-schedules-14,347777165905425a,e07e2119b785] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.692 WARN 77632 --- [pool-ocp-schedules-1,214b8043d06e4d31,b68f3f143489] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.695 WARN 77632 --- [pool-ocp-schedules-13,b7fc72f4eac94384,c123ec75f55e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-4,3289323b7b9f48d8,15aa655b1367] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-9,3289323b7b9f48d8,212f2eefa8f0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-26,3289323b7b9f48d8,c2a0dc850de2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-14,3289323b7b9f48d8,8472f828eecc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-8,3289323b7b9f48d8,9f261ac518ef] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-20,3289323b7b9f48d8,6b430e57182f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-27,3289323b7b9f48d8,f52280d11984] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-7,3289323b7b9f48d8,fc265ba5c7c7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-29,3289323b7b9f48d8,6115d38b0d93] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-19,3289323b7b9f48d8,ae1e423a1f80] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-22,3289323b7b9f48d8,079102ce49d8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.697 WARN 77632 --- [alarm-detect-2,3289323b7b9f48d8,1e66d454b2a6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-6,3289323b7b9f48d8,bae2e11d8d89] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-30,3289323b7b9f48d8,27e5793ac49a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-13,3289323b7b9f48d8,7ee1079aeffa] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-18,3289323b7b9f48d8,e043ac4b7fa8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-10,3289323b7b9f48d8,209cd8b2fd60] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-25,3289323b7b9f48d8,697a9198fcf9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-17,3289323b7b9f48d8,ee3608f5d175] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.698 WARN 77632 --- [alarm-detect-23,3289323b7b9f48d8,a75dcc6839b5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.705 WARN 77632 --- [pool-ocp-schedules-7,1514a0ae59f04c08,6d0deb42e174] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:24.705 ERROR 77632 --- [pool-ocp-schedules-7,1514a0ae59f04c08,6d0deb42e174] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1263, createErrorCount 53 2024-06-04 10:50:24.705 ERROR 77632 --- [pool-ocp-schedules-7,1514a0ae59f04c08,6d0deb42e174] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1263, createErrorCount 53 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:24.747 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:24.747 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1305, createErrorCount 53 2024-06-04 10:50:24.747 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:24.861 WARN 77632 --- [pool-overview-container-3,3abc3f0642024b39,f418a3102b2b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.861 WARN 77632 --- [pool-overview-container-8,6078a909f24b4a04,a69493bcfac0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.861 WARN 77632 --- [pool-overview-container-5,d27098fbf774422d,3759825c8255] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.861 WARN 77632 --- [pool-overview-container-7,5cec0c5823a543bd,40aebb2f577c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.875 WARN 77632 --- [pool-overview-container-6,4c297cb5ee2b4529,e44a57755d2f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.875 WARN 77632 --- [pool-ocp-async-3,c5d6db33ac3d4fa8,559907b27dfa] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.884 WARN 77632 --- [pool-overview-container-4,e9f009f48118483e,fc496a7926a4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.909 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:24.909 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1467, createErrorCount 53 2024-06-04 10:50:24.909 WARN 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.909 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1467, createErrorCount 53 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:24.918 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:24.949 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1507, createErrorCount 53 2024-06-04 10:50:25.023 WARN 77632 --- [pool-ocp-async-10,a3976dc987f64bcb,a036a62f65ed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:25.023 WARN 77632 --- [pool-ocp-async-1,447507677e3d4a94,43713c055604] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:25.023 WARN 77632 --- [pool-ocp-async-2,53741818211a46a5,8f46312b0907] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.023 ERROR 77632 --- [pool-ocp-async-2,53741818211a46a5,8f46312b0907] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1581, createErrorCount 53 2024-06-04 10:50:25.023 INFO 77632 --- [pool-ocp-async-8,2825ec8b7cb14a9b,15626103e4e6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:25.023 WARN 77632 --- [pool-ocp-async-7,4757f9c459af4106,4b28c28cfb7f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.023 ERROR 77632 --- [pool-ocp-async-7,4757f9c459af4106,4b28c28cfb7f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1582, createErrorCount 53 2024-06-04 10:50:25.027 WARN 77632 --- [pool-ocp-async-9,f720a14aa1524b2c,4f49347a2c9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:25.033 WARN 77632 --- [pool-ocp-async-8,2825ec8b7cb14a9b,15626103e4e6] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:25.443 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:25.443 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:25.712 WARN 77632 --- [pool-ocp-async-5,3289323b7b9f48d8,097b8251dfac] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:50:25.713 WARN 77632 --- [alarm-detect-4,3289323b7b9f48d8,15aa655b1367] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.713 ERROR 77632 --- [alarm-detect-4,3289323b7b9f48d8,15aa655b1367] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.713 WARN 77632 --- [alarm-detect-30,3289323b7b9f48d8,27e5793ac49a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.713 ERROR 77632 --- [alarm-detect-30,3289323b7b9f48d8,27e5793ac49a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.713 ERROR 77632 --- [alarm-detect-4,3289323b7b9f48d8,15aa655b1367] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_observer_fd_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.713 WARN 77632 --- [alarm-detect-10,3289323b7b9f48d8,209cd8b2fd60] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-10,3289323b7b9f48d8,209cd8b2fd60] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.714 WARN 77632 --- [alarm-detect-22,3289323b7b9f48d8,079102ce49d8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-22,3289323b7b9f48d8,079102ce49d8] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-10,3289323b7b9f48d8,209cd8b2fd60] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_large_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.713 WARN 77632 --- [alarm-detect-18,3289323b7b9f48d8,e043ac4b7fa8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-18,3289323b7b9f48d8,e043ac4b7fa8] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-22,3289323b7b9f48d8,079102ce49d8] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_mem_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.714 WARN 77632 --- [alarm-detect-6,3289323b7b9f48d8,bae2e11d8d89] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-6,3289323b7b9f48d8,bae2e11d8d89] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.714 ERROR 77632 --- [alarm-detect-18,3289323b7b9f48d8,e043ac4b7fa8] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_expired_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.713 ERROR 77632 --- [alarm-detect-30,3289323b7b9f48d8,27e5793ac49a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=node_file_inode_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.715 ERROR 77632 --- [alarm-detect-6,3289323b7b9f48d8,bae2e11d8d89] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_ntp_offset_too_large org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.715 WARN 77632 --- [alarm-detect-25,3289323b7b9f48d8,697a9198fcf9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.715 ERROR 77632 --- [alarm-detect-25,3289323b7b9f48d8,697a9198fcf9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.715 ERROR 77632 --- [alarm-detect-25,3289323b7b9f48d8,697a9198fcf9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_storage_short_meta_mem_hold_high org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.716 WARN 77632 --- [alarm-detect-23,3289323b7b9f48d8,a75dcc6839b5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.716 ERROR 77632 --- [alarm-detect-23,3289323b7b9f48d8,a75dcc6839b5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.716 ERROR 77632 --- [alarm-detect-23,3289323b7b9f48d8,a75dcc6839b5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_status_check_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.716 WARN 77632 --- [alarm-detect-9,3289323b7b9f48d8,212f2eefa8f0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.716 ERROR 77632 --- [alarm-detect-9,3289323b7b9f48d8,212f2eefa8f0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.717 WARN 77632 --- [alarm-detect-26,3289323b7b9f48d8,c2a0dc850de2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.717 ERROR 77632 --- [alarm-detect-26,3289323b7b9f48d8,c2a0dc850de2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.717 ERROR 77632 --- [alarm-detect-9,3289323b7b9f48d8,212f2eefa8f0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_sstable_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.717 WARN 77632 --- [alarm-detect-14,3289323b7b9f48d8,8472f828eecc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.717 ERROR 77632 --- [alarm-detect-14,3289323b7b9f48d8,8472f828eecc] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.717 ERROR 77632 --- [alarm-detect-26,3289323b7b9f48d8,c2a0dc850de2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_mem_hold_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.717 ERROR 77632 --- [alarm-detect-14,3289323b7b9f48d8,8472f828eecc] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_exists_expired_xa_trans org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.717 WARN 77632 --- [alarm-detect-8,3289323b7b9f48d8,9f261ac518ef] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.718 ERROR 77632 --- [alarm-detect-8,3289323b7b9f48d8,9f261ac518ef] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.718 ERROR 77632 --- [alarm-detect-8,3289323b7b9f48d8,9f261ac518ef] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_no_compaction org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.718 WARN 77632 --- [alarm-detect-20,3289323b7b9f48d8,6b430e57182f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.718 ERROR 77632 --- [alarm-detect-20,3289323b7b9f48d8,6b430e57182f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.719 ERROR 77632 --- [alarm-detect-20,3289323b7b9f48d8,6b430e57182f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=agentd_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.719 WARN 77632 --- [alarm-detect-27,3289323b7b9f48d8,f52280d11984] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.719 ERROR 77632 --- [alarm-detect-27,3289323b7b9f48d8,f52280d11984] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.719 ERROR 77632 --- [alarm-detect-27,3289323b7b9f48d8,f52280d11984] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_no_merge org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.719 WARN 77632 --- [alarm-detect-7,3289323b7b9f48d8,fc265ba5c7c7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.719 ERROR 77632 --- [alarm-detect-7,3289323b7b9f48d8,fc265ba5c7c7] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.720 ERROR 77632 --- [alarm-detect-7,3289323b7b9f48d8,fc265ba5c7c7] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_overload org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.720 WARN 77632 --- [alarm-detect-29,3289323b7b9f48d8,6115d38b0d93] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.720 ERROR 77632 --- [alarm-detect-29,3289323b7b9f48d8,6115d38b0d93] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.720 ERROR 77632 --- [alarm-detect-29,3289323b7b9f48d8,6115d38b0d93] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_connection_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.721 WARN 77632 --- [alarm-detect-2,3289323b7b9f48d8,1e66d454b2a6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.721 ERROR 77632 --- [alarm-detect-2,3289323b7b9f48d8,1e66d454b2a6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.721 ERROR 77632 --- [alarm-detect-2,3289323b7b9f48d8,1e66d454b2a6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_stopped org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.721 WARN 77632 --- [alarm-detect-19,3289323b7b9f48d8,ae1e423a1f80] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.721 ERROR 77632 --- [alarm-detect-19,3289323b7b9f48d8,ae1e423a1f80] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.721 ERROR 77632 --- [alarm-detect-19,3289323b7b9f48d8,ae1e423a1f80] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=observer_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.722 WARN 77632 --- [alarm-detect-13,3289323b7b9f48d8,7ee1079aeffa] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.722 ERROR 77632 --- [alarm-detect-13,3289323b7b9f48d8,7ee1079aeffa] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.722 ERROR 77632 --- [alarm-detect-13,3289323b7b9f48d8,7ee1079aeffa] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=standby_tenant_sync_delay_too_long org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.722 WARN 77632 --- [alarm-detect-17,3289323b7b9f48d8,ee3608f5d175] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.722 ERROR 77632 --- [alarm-detect-17,3289323b7b9f48d8,ee3608f5d175] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:25.722 ERROR 77632 --- [alarm-detect-17,3289323b7b9f48d8,ee3608f5d175] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_full org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:25.930 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.930 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 2024-06-04 10:50:25.931 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:25.931 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:25.936 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:25.936 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:25.939 WARN 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:25.939 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 2024-06-04 10:50:25.939 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 54 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:25.939 INFO 77632 --- [pool-prometheus-minute-schedule-1,4b2c1f1dbffa4eca,7203d37bb9b3] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469421938, count=0, elapsed=4001 2024-06-04 10:50:25.939 INFO 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:26.005 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:26.013 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.013 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.162 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:26.300 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:26.687 WARN 77632 --- [pool-ocp-schedules-2,05881aa7280d4ed3,4c897fe44662] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.688 ERROR 77632 --- [pool-ocp-schedules-2,05881aa7280d4ed3,4c897fe44662] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 174, createErrorCount 55 2024-06-04 10:50:26.688 ERROR 77632 --- [pool-ocp-schedules-2,05881aa7280d4ed3,4c897fe44662] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 174, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.688 WARN 77632 --- [pool-ocp-schedules-12,1bc9ae75d607455e,e225a40bfc05] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.688 ERROR 77632 --- [pool-ocp-schedules-12,1bc9ae75d607455e,e225a40bfc05] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 174, createErrorCount 55 2024-06-04 10:50:26.688 ERROR 77632 --- [pool-ocp-schedules-12,1bc9ae75d607455e,e225a40bfc05] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 174, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.689 WARN 77632 --- [pool-ocp-schedules-18,357889975e6b4b42,b5d1b64ad881] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.689 ERROR 77632 --- [pool-ocp-schedules-18,357889975e6b4b42,b5d1b64ad881] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 176, createErrorCount 55 2024-06-04 10:50:26.689 ERROR 77632 --- [pool-ocp-schedules-18,357889975e6b4b42,b5d1b64ad881] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 176, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.691 WARN 77632 --- [pool-ocp-schedules-3,3e17b27d035e4720,9f7a6b32b3dc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.691 ERROR 77632 --- [pool-ocp-schedules-3,3e17b27d035e4720,9f7a6b32b3dc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 177, createErrorCount 55 2024-06-04 10:50:26.691 WARN 77632 --- [pool-ocp-schedules-19,98fd5467ac224fd6,f3f5c0eed6c5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.691 ERROR 77632 --- [pool-ocp-schedules-19,98fd5467ac224fd6,f3f5c0eed6c5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 177, createErrorCount 55 2024-06-04 10:50:26.691 ERROR 77632 --- [pool-ocp-schedules-3,3e17b27d035e4720,9f7a6b32b3dc] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 177, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.691 ERROR 77632 --- [pool-ocp-schedules-19,98fd5467ac224fd6,f3f5c0eed6c5] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 177, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.691 WARN 77632 --- [pool-ocp-schedules-14,347777165905425a,e07e2119b785] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.691 ERROR 77632 --- [pool-ocp-schedules-14,347777165905425a,e07e2119b785] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 178, createErrorCount 55 2024-06-04 10:50:26.692 ERROR 77632 --- [pool-ocp-schedules-14,347777165905425a,e07e2119b785] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 178, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.692 WARN 77632 --- [pool-ocp-schedules-1,214b8043d06e4d31,b68f3f143489] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.692 ERROR 77632 --- [pool-ocp-schedules-1,214b8043d06e4d31,b68f3f143489] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 178, createErrorCount 55 2024-06-04 10:50:26.692 ERROR 77632 --- [pool-ocp-schedules-1,214b8043d06e4d31,b68f3f143489] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 178, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.695 WARN 77632 --- [pool-ocp-schedules-13,b7fc72f4eac94384,c123ec75f55e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.695 ERROR 77632 --- [pool-ocp-schedules-13,b7fc72f4eac94384,c123ec75f55e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 181, createErrorCount 55 2024-06-04 10:50:26.695 ERROR 77632 --- [pool-ocp-schedules-13,b7fc72f4eac94384,c123ec75f55e] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 181, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.764 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:26.861 WARN 77632 --- [pool-overview-container-3,3abc3f0642024b39,f418a3102b2b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.861 ERROR 77632 --- [pool-overview-container-3,3abc3f0642024b39,f418a3102b2b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 2024-06-04 10:50:26.861 WARN 77632 --- [pool-overview-container-8,6078a909f24b4a04,a69493bcfac0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.861 WARN 77632 --- [pool-overview-container-5,d27098fbf774422d,3759825c8255] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.861 ERROR 77632 --- [pool-overview-container-8,6078a909f24b4a04,a69493bcfac0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 2024-06-04 10:50:26.861 ERROR 77632 --- [pool-overview-container-5,d27098fbf774422d,3759825c8255] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 2024-06-04 10:50:26.862 WARN 77632 --- [pool-overview-container-7,5cec0c5823a543bd,40aebb2f577c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.861 ERROR 77632 --- [pool-overview-container-8,6078a909f24b4a04,a69493bcfac0] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.861 ERROR 77632 --- [pool-overview-container-5,d27098fbf774422d,3759825c8255] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.862 WARN 77632 --- [pool-overview-container-8,6078a909f24b4a04,a69493bcfac0] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.862 ERROR 77632 --- [pool-overview-container-7,5cec0c5823a543bd,40aebb2f577c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 348, createErrorCount 55 2024-06-04 10:50:26.865 ERROR 77632 --- [pool-overview-container-7,5cec0c5823a543bd,40aebb2f577c] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 348, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.864 WARN 77632 --- [pool-overview-container-5,d27098fbf774422d,3759825c8255] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.865 WARN 77632 --- [pool-overview-container-7,5cec0c5823a543bd,40aebb2f577c] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 348, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.866 ERROR 77632 --- [pool-overview-container-3,3abc3f0642024b39,f418a3102b2b] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.866 WARN 77632 --- [pool-overview-container-3,3abc3f0642024b39,f418a3102b2b] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.875 WARN 77632 --- [pool-overview-container-6,4c297cb5ee2b4529,e44a57755d2f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.875 WARN 77632 --- [pool-ocp-async-3,c5d6db33ac3d4fa8,559907b27dfa] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.875 ERROR 77632 --- [pool-ocp-async-3,c5d6db33ac3d4fa8,559907b27dfa] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 361, createErrorCount 55 2024-06-04 10:50:26.875 ERROR 77632 --- [pool-overview-container-6,4c297cb5ee2b4529,e44a57755d2f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 361, createErrorCount 55 2024-06-04 10:50:26.875 ERROR 77632 --- [pool-overview-container-6,4c297cb5ee2b4529,e44a57755d2f] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 361, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.876 WARN 77632 --- [pool-overview-container-6,4c297cb5ee2b4529,e44a57755d2f] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 361, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.886 WARN 77632 --- [pool-overview-container-4,e9f009f48118483e,fc496a7926a4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.886 ERROR 77632 --- [pool-overview-container-4,e9f009f48118483e,fc496a7926a4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 372, createErrorCount 55 2024-06-04 10:50:26.886 ERROR 77632 --- [pool-overview-container-4,e9f009f48118483e,fc496a7926a4] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 372, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.886 WARN 77632 --- [pool-overview-container-4,e9f009f48118483e,fc496a7926a4] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 372, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.909 WARN 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.909 ERROR 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 396, createErrorCount 55 2024-06-04 10:50:26.910 ERROR 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$1(OcpMonitorManager.java:135) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 396, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.910 INFO 77632 --- [pool-prometheus-hour-schedule-1,de849b8d93b8405e,b0e24a41dee9] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469422909, count=0, elapsed=4001 2024-06-04 10:50:26.918 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:26.918 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 404, createErrorCount 55 2024-06-04 10:50:26.919 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 404, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:26.949 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:27.023 INFO 77632 --- [pool-ocp-async-5,e52db4ebd1c247dc,d552967fe810] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:27.023 WARN 77632 --- [pool-ocp-async-10,a3976dc987f64bcb,a036a62f65ed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:27.023 ERROR 77632 --- [pool-ocp-async-10,a3976dc987f64bcb,a036a62f65ed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 510, createErrorCount 55 2024-06-04 10:50:27.023 WARN 77632 --- [pool-ocp-async-4,21661596a9914db1,836b0f8bd417] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:27.023 WARN 77632 --- [pool-ocp-async-1,447507677e3d4a94,43713c055604] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:27.023 ERROR 77632 --- [pool-ocp-async-1,447507677e3d4a94,43713c055604] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 510, createErrorCount 55 2024-06-04 10:50:27.024 WARN 77632 --- [pool-ocp-async-6,4ad07b96348e4d8c,f7fbca3f393a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:27.027 WARN 77632 --- [pool-ocp-async-9,f720a14aa1524b2c,4f49347a2c9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:27.027 ERROR 77632 --- [pool-ocp-async-9,f720a14aa1524b2c,4f49347a2c9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 513, createErrorCount 55 2024-06-04 10:50:27.932 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:27.932 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1418, createErrorCount 55 2024-06-04 10:50:27.932 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:27.939 WARN 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:28.005 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:28.005 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1491, createErrorCount 55 2024-06-04 10:50:28.005 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:28.164 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:28.164 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 1, createElapseMillis 1650, createErrorCount 55 2024-06-04 10:50:28.164 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:28.301 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:28.301 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1787, createErrorCount 55 2024-06-04 10:50:28.301 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1787, createErrorCount 55 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:28.516 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:28.516 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:28.764 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:28.764 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 56 2024-06-04 10:50:28.765 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 56 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:28.936 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:28.949 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 56 2024-06-04 10:50:29.023 INFO 77632 --- [pool-ocp-async-3,48603420850a47f1,7fb20e4cb26f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:29.023 WARN 77632 --- [pool-ocp-async-2,29ca695b4e384914,09f6dadd46a9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:29.023 WARN 77632 --- [pool-ocp-async-8,d51a7c7cd60046ef,6f20da0c3243] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:29.023 WARN 77632 --- [pool-ocp-async-4,21661596a9914db1,836b0f8bd417] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:29.023 ERROR 77632 --- [pool-ocp-async-4,21661596a9914db1,836b0f8bd417] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 7, createErrorCount 56 2024-06-04 10:50:29.024 WARN 77632 --- [pool-ocp-async-6,4ad07b96348e4d8c,f7fbca3f393a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:29.024 ERROR 77632 --- [pool-ocp-async-6,4ad07b96348e4d8c,f7fbca3f393a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 7, createErrorCount 56 2024-06-04 10:50:29.027 WARN 77632 --- [pool-ocp-async-5,e52db4ebd1c247dc,d552967fe810] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:29.033 WARN 77632 --- [pool-ocp-async-3,48603420850a47f1,7fb20e4cb26f] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:29.085 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:29.085 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:29.910 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:29.940 WARN 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:29.940 ERROR 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 354, createErrorCount 57 2024-06-04 10:50:29.940 ERROR 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 354, createErrorCount 57 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:29.940 INFO 77632 --- [pool-prometheus-minute-schedule-1,2ac34de4bd66442f,c6c0191d3d28] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469425939, count=0, elapsed=4001 2024-06-04 10:50:29.940 INFO 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:30.278 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:30.322 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:30.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:50:30.671 INFO 77632 --- [pool-print-time-series-interval15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469430: {1717469220=57, 1717469235=57, 1717469250=57, 1717469265=57, 1717469280=57, 1717469295=57, 1717469310=57, 1717469325=8}, tsDataMapSize: 57032, readyDataCacheSize: 36176 2024-06-04 10:50:30.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:50:30.709 INFO 77632 --- [pool-print-time-series-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469430: {}, tsDataMapSize: 80, readyDataCacheSize: 64 2024-06-04 10:50:30.931 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:30.933 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:30.936 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:30.936 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1350, createErrorCount 57 2024-06-04 10:50:30.936 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1350, createErrorCount 57 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:30.937 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:30.950 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.005 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.023 WARN 77632 --- [pool-ocp-async-2,29ca695b4e384914,09f6dadd46a9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:31.024 ERROR 77632 --- [pool-ocp-async-2,29ca695b4e384914,09f6dadd46a9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1437, createErrorCount 57 2024-06-04 10:50:31.024 INFO 77632 --- [pool-ocp-async-1,af5f28b7c4d344b9,81e7bb97af6b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:31.024 WARN 77632 --- [pool-ocp-async-8,d51a7c7cd60046ef,6f20da0c3243] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:31.024 ERROR 77632 --- [pool-ocp-async-8,d51a7c7cd60046ef,6f20da0c3243] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1438, createErrorCount 57 2024-06-04 10:50:31.024 WARN 77632 --- [pool-ocp-async-10,67d965e5e07f45b3,ec6eecad0a99] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.023 WARN 77632 --- [pool-ocp-async-7,cd94492af6a243ce,fb0f8fc3dc7d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.027 WARN 77632 --- [pool-ocp-async-5,e52db4ebd1c247dc,d552967fe810] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:31.027 ERROR 77632 --- [pool-ocp-async-5,e52db4ebd1c247dc,d552967fe810] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1441, createErrorCount 57 2024-06-04 10:50:31.112 INFO 77632 --- [pool-metric-parse-3,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469430, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:50:31.164 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.301 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.588 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:31.588 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:31.590 WARN 77632 --- [pool-ocp-schedules-20,71e28a80c4c149c7,e2469f2ef2a6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.747 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.767 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.815 INFO 77632 --- [pool-ocp-schedules-15,d4675930a8064393,cf8b1a57af14] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:50:31.910 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:31.910 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 58 2024-06-04 10:50:31.911 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 58 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:31.919 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:31.940 WARN 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:32.158 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:32.158 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:32.278 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:32.278 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 59 2024-06-04 10:50:32.278 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:32.304 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:32.322 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:32.323 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 59 2024-06-04 10:50:32.323 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:32.694 INFO 77632 --- [pool-ocp-async-8,000aa8d772b94574,bb4dfb88e092] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:32.706 WARN 77632 --- [pool-scanner-12457-1,000aa8d772b94574,73fcdef51e03] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:32.878 INFO 77632 --- [pool-ocp-async-5,a2521c4ec4dc4885,0a2c9e45368f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:32.932 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:32.932 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 273, createErrorCount 59 2024-06-04 10:50:32.932 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 273, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:32.933 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:32.933 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 274, createErrorCount 59 2024-06-04 10:50:32.933 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:32.937 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 278, createErrorCount 59 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 278, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:32.937 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:32.950 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 291, createErrorCount 59 2024-06-04 10:50:33.005 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.006 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 347, createErrorCount 59 2024-06-04 10:50:33.006 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:33.024 INFO 77632 --- [pool-ocp-async-9,dd63947db7b34489,36aa49c41fbd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:33.024 WARN 77632 --- [pool-ocp-async-2,e2ab35a4e744408d,e7bd1a5eddff] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:33.024 WARN 77632 --- [pool-ocp-async-10,67d965e5e07f45b3,ec6eecad0a99] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.024 ERROR 77632 --- [pool-ocp-async-10,67d965e5e07f45b3,ec6eecad0a99] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 365, createErrorCount 59 2024-06-04 10:50:33.024 WARN 77632 --- [pool-ocp-async-7,cd94492af6a243ce,fb0f8fc3dc7d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.024 ERROR 77632 --- [pool-ocp-async-7,cd94492af6a243ce,fb0f8fc3dc7d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 365, createErrorCount 59 2024-06-04 10:50:33.024 WARN 77632 --- [pool-ocp-async-4,97cd5c33fc754134,428a21130a16] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:33.028 WARN 77632 --- [pool-ocp-async-1,af5f28b7c4d344b9,81e7bb97af6b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:33.034 WARN 77632 --- [pool-ocp-async-9,dd63947db7b34489,36aa49c41fbd] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:33.164 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.164 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 505, createErrorCount 59 2024-06-04 10:50:33.165 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:33.302 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.302 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 643, createErrorCount 59 2024-06-04 10:50:33.302 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 643, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:33.477 WARN 77632 --- [pool-ocp-schedules-8,bca94ae1c88a4c1b,093d01d8f0a1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:33.590 WARN 77632 --- [pool-ocp-schedules-20,71e28a80c4c149c7,e2469f2ef2a6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.590 ERROR 77632 --- [pool-ocp-schedules-20,71e28a80c4c149c7,e2469f2ef2a6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 931, createErrorCount 59 2024-06-04 10:50:33.590 ERROR 77632 --- [pool-ocp-schedules-20,71e28a80c4c149c7,e2469f2ef2a6] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 931, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:33.748 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.748 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1089, createErrorCount 59 2024-06-04 10:50:33.748 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:33.767 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.767 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1108, createErrorCount 59 2024-06-04 10:50:33.767 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1108, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:33.815 WARN 77632 --- [pool-ocp-schedules-15,d4675930a8064393,cf8b1a57af14] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:33.919 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.920 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1261, createErrorCount 59 2024-06-04 10:50:33.920 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1261, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:33.941 WARN 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:33.941 ERROR 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1282, createErrorCount 59 2024-06-04 10:50:33.941 ERROR 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1282, createErrorCount 59 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:33.941 INFO 77632 --- [pool-prometheus-minute-schedule-1,9ce4a13686e24c2a,8fe7819a96cb] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469429940, count=0, elapsed=4001 2024-06-04 10:50:33.941 INFO 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:34.304 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1645, createErrorCount 59 2024-06-04 10:50:34.661 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:34.661 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:34.861 WARN 77632 --- [pool-overview-container-2,61ed2fc43cc5461e,6e679bd95c1d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.861 WARN 77632 --- [pool-overview-container-1,c15a30cc3b634844,80e9b34ab14c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.861 WARN 77632 --- [pool-overview-container-5,1863bc9f656a46e8,2d312c3414d3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.861 WARN 77632 --- [pool-overview-container-8,19da2926c5604266,09a8fb216c61] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.879 WARN 77632 --- [pool-ocp-async-5,a2521c4ec4dc4885,0a2c9e45368f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.879 WARN 77632 --- [pool-overview-container-7,590c5a806e88446f,a5b2da2543e2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.885 WARN 77632 --- [pool-overview-container-3,474f283ad44c4213,58bbe2bd91a4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:34.950 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:35.024 INFO 77632 --- [pool-ocp-async-10,0c4a91630da543d2,da01e6522eec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:35.024 WARN 77632 --- [pool-ocp-async-8,59d4b2483e864123,48cfbf13fb6f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:35.024 WARN 77632 --- [pool-ocp-async-2,e2ab35a4e744408d,e7bd1a5eddff] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:35.024 ERROR 77632 --- [pool-ocp-async-2,e2ab35a4e744408d,e7bd1a5eddff] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 60 2024-06-04 10:50:35.024 WARN 77632 --- [pool-ocp-async-6,91b46f6291da4553,dcb35e0d864c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:35.024 WARN 77632 --- [pool-ocp-async-4,97cd5c33fc754134,428a21130a16] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:35.024 ERROR 77632 --- [pool-ocp-async-4,97cd5c33fc754134,428a21130a16] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 60 2024-06-04 10:50:35.032 WARN 77632 --- [pool-ocp-async-1,af5f28b7c4d344b9,81e7bb97af6b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:35.032 ERROR 77632 --- [pool-ocp-async-1,af5f28b7c4d344b9,81e7bb97af6b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2004, active 0, maxActive 200, creating 0, createErrorCount 60 2024-06-04 10:50:35.153 INFO 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=Ren_Test&version=2&ObClusterId=1717467632, client=0:0:0:0:0:0:0:1, traceId=86311ee1d8ef4c00, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469433149321,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2024-06-04 10:50:35.230 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:35.230 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:35.477 WARN 77632 --- [pool-ocp-schedules-8,bca94ae1c88a4c1b,093d01d8f0a1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:35.478 ERROR 77632 --- [pool-ocp-schedules-8,bca94ae1c88a4c1b,093d01d8f0a1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 61 2024-06-04 10:50:35.478 ERROR 77632 --- [pool-ocp-schedules-8,bca94ae1c88a4c1b,093d01d8f0a1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:35.815 WARN 77632 --- [pool-ocp-schedules-15,d4675930a8064393,cf8b1a57af14] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:35.816 ERROR 77632 --- [pool-ocp-schedules-15,d4675930a8064393,cf8b1a57af14] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 85, createErrorCount 61 2024-06-04 10:50:35.816 ERROR 77632 --- [pool-ocp-schedules-15,d4675930a8064393,cf8b1a57af14] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 85, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:35.933 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:35.938 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:35.941 WARN 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.006 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.165 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.302 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.706 WARN 77632 --- [pool-ocp-schedules-2,b3dfc45a55804fbc,f18d76b45fde] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.768 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.861 WARN 77632 --- [pool-overview-container-2,61ed2fc43cc5461e,6e679bd95c1d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.861 ERROR 77632 --- [pool-overview-container-2,61ed2fc43cc5461e,6e679bd95c1d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1130, createErrorCount 61 2024-06-04 10:50:36.862 ERROR 77632 --- [pool-overview-container-2,61ed2fc43cc5461e,6e679bd95c1d] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1130, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.862 WARN 77632 --- [pool-overview-container-8,19da2926c5604266,09a8fb216c61] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.862 ERROR 77632 --- [pool-overview-container-8,19da2926c5604266,09a8fb216c61] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 2024-06-04 10:50:36.862 WARN 77632 --- [pool-overview-container-2,61ed2fc43cc5461e,6e679bd95c1d] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1130, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.862 WARN 77632 --- [pool-overview-container-1,c15a30cc3b634844,80e9b34ab14c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.862 ERROR 77632 --- [pool-overview-container-1,c15a30cc3b634844,80e9b34ab14c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 2024-06-04 10:50:36.862 ERROR 77632 --- [pool-overview-container-8,19da2926c5604266,09a8fb216c61] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.862 ERROR 77632 --- [pool-overview-container-1,c15a30cc3b634844,80e9b34ab14c] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.862 WARN 77632 --- [pool-overview-container-8,19da2926c5604266,09a8fb216c61] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.863 WARN 77632 --- [pool-overview-container-1,c15a30cc3b634844,80e9b34ab14c] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.863 WARN 77632 --- [pool-overview-container-5,1863bc9f656a46e8,2d312c3414d3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.863 ERROR 77632 --- [pool-overview-container-5,1863bc9f656a46e8,2d312c3414d3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1132, createErrorCount 61 2024-06-04 10:50:36.863 ERROR 77632 --- [pool-overview-container-5,1863bc9f656a46e8,2d312c3414d3] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1132, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.863 WARN 77632 --- [pool-overview-container-5,1863bc9f656a46e8,2d312c3414d3] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1132, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.879 WARN 77632 --- [pool-ocp-async-5,a2521c4ec4dc4885,0a2c9e45368f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.879 ERROR 77632 --- [pool-ocp-async-5,a2521c4ec4dc4885,0a2c9e45368f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1148, createErrorCount 61 2024-06-04 10:50:36.879 WARN 77632 --- [pool-overview-container-7,590c5a806e88446f,a5b2da2543e2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.879 ERROR 77632 --- [pool-overview-container-7,590c5a806e88446f,a5b2da2543e2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1148, createErrorCount 61 2024-06-04 10:50:36.879 ERROR 77632 --- [pool-overview-container-7,590c5a806e88446f,a5b2da2543e2] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1148, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.880 WARN 77632 --- [pool-overview-container-7,590c5a806e88446f,a5b2da2543e2] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1148, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.885 WARN 77632 --- [pool-overview-container-3,474f283ad44c4213,58bbe2bd91a4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:36.885 ERROR 77632 --- [pool-overview-container-3,474f283ad44c4213,58bbe2bd91a4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1154, createErrorCount 61 2024-06-04 10:50:36.885 ERROR 77632 --- [pool-overview-container-3,474f283ad44c4213,58bbe2bd91a4] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1154, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.885 WARN 77632 --- [pool-overview-container-3,474f283ad44c4213,58bbe2bd91a4] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1154, createErrorCount 61 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:36.911 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:36.950 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1220, createErrorCount 61 2024-06-04 10:50:37.024 WARN 77632 --- [pool-ocp-async-3,97cebb3b779346d0,656d9a6e1aaa] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.024 INFO 77632 --- [pool-ocp-async-2,514cef18ee834237,43e1f0cca226] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:37.024 WARN 77632 --- [pool-ocp-async-8,59d4b2483e864123,48cfbf13fb6f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:37.024 ERROR 77632 --- [pool-ocp-async-8,59d4b2483e864123,48cfbf13fb6f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1293, createErrorCount 61 2024-06-04 10:50:37.024 WARN 77632 --- [pool-ocp-async-6,91b46f6291da4553,dcb35e0d864c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:37.024 ERROR 77632 --- [pool-ocp-async-6,91b46f6291da4553,dcb35e0d864c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1293, createErrorCount 61 2024-06-04 10:50:37.024 WARN 77632 --- [pool-ocp-async-7,486a0115104441f0,eb7401f2d6f2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.033 WARN 77632 --- [pool-ocp-async-10,0c4a91630da543d2,da01e6522eec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.034 WARN 77632 --- [pool-ocp-async-2,514cef18ee834237,43e1f0cca226] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:37.153 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.247 WARN 77632 --- [pool-ocp-schedules-5,30a605673ae24108,9f20b38d950c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.733 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:37.733 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:37.933 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.934 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:37.934 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 2024-06-04 10:50:37.934 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:37.938 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:37.938 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 2024-06-04 10:50:37.938 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:37.939 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:37.942 WARN 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:37.942 ERROR 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 2024-06-04 10:50:37.942 ERROR 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:37.942 INFO 77632 --- [pool-prometheus-minute-schedule-1,250df3c9f33d422e,8002602ab0d3] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469433941, count=0, elapsed=4001 2024-06-04 10:50:37.942 INFO 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:38.006 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.006 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 2024-06-04 10:50:38.006 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:38.165 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.165 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 62 2024-06-04 10:50:38.165 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:38.301 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.301 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.302 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.302 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 2024-06-04 10:50:38.303 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.706 WARN 77632 --- [pool-ocp-schedules-2,b3dfc45a55804fbc,f18d76b45fde] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.706 ERROR 77632 --- [pool-ocp-schedules-2,b3dfc45a55804fbc,f18d76b45fde] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 2024-06-04 10:50:38.707 ERROR 77632 --- [pool-ocp-schedules-2,b3dfc45a55804fbc,f18d76b45fde] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.768 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.768 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 2024-06-04 10:50:38.768 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.911 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:38.911 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 110, createErrorCount 63 2024-06-04 10:50:38.912 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 110, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:38.921 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:38.951 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:39.024 WARN 77632 --- [pool-ocp-async-3,97cebb3b779346d0,656d9a6e1aaa] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.024 ERROR 77632 --- [pool-ocp-async-3,97cebb3b779346d0,656d9a6e1aaa] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 222, createErrorCount 63 2024-06-04 10:50:39.024 INFO 77632 --- [pool-ocp-async-3,12f480f195b2428c,7f6d80d34098] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:39.025 WARN 77632 --- [pool-ocp-async-5,da847558676f41ab,40b4a93ff532] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:39.025 WARN 77632 --- [pool-ocp-async-9,015a418b9d9f4596,9a03d7add24f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:39.028 WARN 77632 --- [pool-ocp-async-7,486a0115104441f0,eb7401f2d6f2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.028 ERROR 77632 --- [pool-ocp-async-7,486a0115104441f0,eb7401f2d6f2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 226, createErrorCount 63 2024-06-04 10:50:39.033 WARN 77632 --- [pool-ocp-async-10,0c4a91630da543d2,da01e6522eec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.033 ERROR 77632 --- [pool-ocp-async-10,0c4a91630da543d2,da01e6522eec] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 231, createErrorCount 63 2024-06-04 10:50:39.153 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.154 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 352, createErrorCount 63 2024-06-04 10:50:39.154 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [POST /services client=0:0:0:0:0:0:0:1, traceId=86311ee1d8ef4c00, args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469433149321,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},, duration=4003 ms] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 352, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:39.155 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-3,86311ee1d8ef4c00,6ba59780add5] c.o.o.s.c.exception.RpcExceptionHandler : Unhandled exception, uri=/services, duration=4004 org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 352, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:39.248 WARN 77632 --- [pool-ocp-schedules-5,30a605673ae24108,9f20b38d950c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.248 ERROR 77632 --- [pool-ocp-schedules-5,30a605673ae24108,9f20b38d950c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 446, createErrorCount 63 2024-06-04 10:50:39.248 ERROR 77632 --- [pool-ocp-schedules-5,30a605673ae24108,9f20b38d950c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at collect-obproxy-metrics at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.lockAndExec(ObproxySchedules.java:34) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.collectObproxyMetrics(ObproxySchedules.java:29) at sun.reflect.GeneratedMethodAccessor502.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 446, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:39.280 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:39.323 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:39.933 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:39.933 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 63 2024-06-04 10:50:39.934 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1131, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:39.939 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1137, createErrorCount 63 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1137, createErrorCount 63 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:39.939 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:39.942 WARN 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:40.748 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:40.804 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:40.804 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:40.921 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:40.921 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 2024-06-04 10:50:40.921 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:40.934 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:40.951 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 2024-06-04 10:50:41.007 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.024 WARN 77632 --- [pool-ocp-async-4,c12229be59ca4af7,157c96edf236] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.024 INFO 77632 --- [pool-ocp-async-2,e965ac5f2ad146f9,14d3e35d3d9f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:41.025 WARN 77632 --- [pool-ocp-async-5,da847558676f41ab,40b4a93ff532] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:41.025 ERROR 77632 --- [pool-ocp-async-5,da847558676f41ab,40b4a93ff532] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 2024-06-04 10:50:41.025 WARN 77632 --- [pool-ocp-async-9,015a418b9d9f4596,9a03d7add24f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:41.025 ERROR 77632 --- [pool-ocp-async-9,015a418b9d9f4596,9a03d7add24f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 2024-06-04 10:50:41.028 WARN 77632 --- [pool-ocp-async-8,d9d14b36fefc4224,d728815f0b4f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.033 WARN 77632 --- [pool-ocp-async-3,12f480f195b2428c,7f6d80d34098] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.034 WARN 77632 --- [pool-ocp-async-2,e965ac5f2ad146f9,14d3e35d3d9f] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:41.045 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.165 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.214 INFO 77632 --- [pool-12-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Not the leader for service:PLAN_CHANGE_DETECTOR, skipped 2024-06-04 10:50:41.280 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:41.280 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 64 2024-06-04 10:50:41.280 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:41.303 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.323 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:41.323 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 19, createErrorCount 64 2024-06-04 10:50:41.323 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:41.373 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:41.373 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:41.769 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:41.909 INFO 77632 --- [pool-prometheus-cache-monitor1,f39c56cd8dc04440,ab3f03aeda9c] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1744,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":4854,"secondWriteQueue":0,"minuteWriteCacheSize":955} 2024-06-04 10:50:41.910 INFO 77632 --- [pool-prometheus-cache-monitor1,f39c56cd8dc04440,ab3f03aeda9c] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, node_memory_sreclaimable_bytes=12, ob_sysstat_40011=17, ob_server_resource_memory_assigned_bytes=10, ob_sysstat_40010=17, tcp_retrans=13, ob_unit_num=10, ob_database_disk_required_size=31, go_memstats_mspan_sys_bytes=10, ob_sysstat_30213=17, go_memstats_stack_sys_bytes=10, ob_sysstat_30212=17, exporter_export_metrics_bytes_total=20, ob_sysstat_30217=17, node_filesystem_size_bytes=35, ob_sysstat_30216=17, http_server_requests_seconds_count=60, ob_tenant_request_queue_total_size=20, jvm_gc_memory_allocated_bytes_total=5, ob_system_event_total_waits=21, monagent_input_sql_duration_seconds_sum=55, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=15, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=5, node_filesystem_readonly=35, go_memstats_frees_total=10, io_await=31, host_available=7, ob_sysstat_30220=17, ob_sysstat_30222=17, ob_sysstat_30221=17, go_memstats_mallocs_total=10, ob_unit_config_max_memory_bytes=19, ob_database_disk_data_size=30, io_util=31, ob_sysstat_200002=17, ob_tenant_memstore_freeze_cnt=14, ob_sysstat_200001=17, ob_tenant_disk_v4_data_size=12, ob_tenant_unit_min_memory=26, ob_sysstat_60087=17, ob_memstore_total_bytes=20, metric_cardinality_count=12, jvm_threads_states_threads=10, process_resident_memory_bytes=10, ob_cache_size_bytes=28, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=26, input_collect_metrics_total=15, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=20, node_disk_write_time_seconds_total=20, cpu_count=13, ob_cluster_sync=6, process_open_fds=10, ob_sysstat_50037=17, process_memory_rss_bytes=17, http_status_count=13, process_max_fds=10, ob_server_resource_cpu_assigned_percent=10, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=122, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=10, go_memstats_mcache_sys_bytes=10, ob_sysstat_40118=17, ob_sysstat_40117=17, ob_tenant_disk_v4_log_size=12, node_memory_memfree_bytes=12, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=26, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=15, ob_sysstat_40001=17, ob_server_resource_disk_bytes=10, ocp_alarm_detect_duration_ms_sum=122, ob_sysstat_40000=17, jvm_threads_live_threads=5, ob_sysstat_30200=17, ob_sysstat_30201=17, ob_sysstat_30204=17, ob_sysstat_30205=17, ob_sysstat_30208=17, process_thread_count=17, ob_sysstat_30209=17, node_memory_cached_bytes=12, ob_sysstat_50040=17, ob_table_num=16, ob_sysstat_40009=17, ob_sysstat_40008=17, ob_disk_free_bytes=10, node_filesystem_avail_bytes=35, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=19, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=16, go_memstats_last_gc_time_seconds=10, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=10, ocp_monitor_collect_request_duration_ms_count=9, monagent_oceanbase_plan_explain_size=3, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=31, node_disk_read_bytes_total=20, clock_diff_milliseconds=6, ob_compaction_is_suspended=12, go_memstats_lookups_total=10, process_cpu_percent=17, log_tailer_count=10, ob_sysstat_60057=17, host_agent_process_status=10, ob_server_resource_cpu=10, go_memstats_alloc_bytes=10, ob_server_num=14, node_cpu_seconds_total_native=18, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_session_all_num=16, ob_tenant_resource_min_memory=16, jvm_gc_pause_seconds_count=9, ob_memstore_freeze_times=20, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=5, ob_system_event_time_waited=21, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=24, jvm_memory_committed_bytes=12, node_net_bandwidth_bps=16, monagent_oceanbase_db_pool_idle=3, ob_tenant_server_data_index_data_size=15, go_memstats_heap_idle_bytes=10, go_memstats_gc_sys_bytes=10, ob_server_resource_memory_bytes=10, go_info=11, ob_tenant_assigned_mem_assigned=16, log_tailer_processed_file_count=10, node_load15=12, ob_tenant_memstore_minor_freeze_times=14, ob_disk_log_assigned_bytes=10, ob_tenant_server_required_size=15, jvm_memory_max_bytes=12, ob_unit_config_min_iops=19, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=17, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_sysstat_30084=17, ob_tenant_unit_max_cpu=26, ob_sysstat_30083=17, node_memory_buffers_bytes=12, ob_sysstat_30086=17, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=10, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=16, ob_sysstat_50005=17, ob_sysstat_50008=17, ob_memstore_freeze_trigger_bytes=20, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=11, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=10, ob_session_active_num=16, node_filesystem_files_free=43, ob_memtable_max_snapshot_duration_seconds=10, node_disk_read_time_seconds_total=20, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=3, ob_sysstat_60024=17, ob_compaction_frozen_version=12, ob_sysstat_60023=17, metric_count=10, ob_sysstat_60022=17, process_virtual_memory_bytes=10, observer_coredump_time_seconds=10, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=26, ob_unit_config_max_cpu=19, http_request_milliseconds_summary_count=27, monagent_oceanbase_audit_timeinfo_cache_size=3, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=59, ob_sysstat_20001=17, node_cpu_seconds_total=20, ob_sysstat_20000=17, http_request_milliseconds_summary=30, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=12, go_memstats_buck_hash_sys_bytes=10, monagent_pipeline_report_metrics_total=10, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=20, exporter_export_metrics_total=20, ob_disk_log_total_bytes=10, ob_sysstat_60019=17, system_cpu_count=5, process_uptime_seconds=17, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=10, ocp_meta_db_health=6, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=9, ob_disk_total_bytes=10, watch_ob_dir_exists=15, ob_tenant_request_queue_large_size=20, go_memstats_heap_objects=10, go_memstats_mcache_inuse_bytes=10, go_memstats_other_sys_bytes=10, ob_sysstat_130000=17, jvm_memory_used_bytes=12, ob_sysstat_130001=17, go_threads=10, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=27, http_server_requests_seconds_sum=60, ob_memstore_active_bytes=20, go_memstats_alloc_bytes_total=10, ob_tenant_assigned_mem_total=16, process_count=18, node_memory_memtotal_bytes=12, node_network_transmit_drop_total=16, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=5, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=10, ob_tenant500_memory_used_bytes=10, node_network_transmit_bytes_total=16, ob_compaction_is_error=12, node_network_receive_drop_total=16, monagent_pipeline_execute_total=16, node_filesystem_files=43, process_start_time_seconds=10, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=10, ob_tenant_resource_max_cpu=16, go_gc_duration_seconds_sum=10, go_memstats_mspan_inuse_bytes=10, ob_server_resource_memory_assigned_percent=10, monagent_pipeline_execute_seconds_total=16, jvm_gc_pause_seconds_sum=9, ob_sysstat_80001=17, go_memstats_sys_bytes=10, node_network_receive_errs_total=16, system_load_average_1m=5, monagent_oceanbase_audit_stat_cache_size=3, observer_ulimit_max_fd_count=10, ob_plan_cache_access_total=16, ob_tenant_memory_used_bytes=16, monagent_oceanbase_plan_cache_size=3, monagent_oceanbase_audit_sample_cache_size=3, ob_tenant_server_data_size=15, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=20, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=10, node_load1=12, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=5, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=10, ob_sysstat_120008=17, node_load5=12, ob_sysstat_120005=17, jvm_threads_peak_threads=5, ob_sysstat_120006=17, process_cpu_usage=5, monagent_input_sql_duration_seconds_count=55, node_disk_written_bytes_total=20, monagent_oceanbase_ash_cache_size=3, monagent_pipeline_process_metrics_total=20, go_goroutines=10, ob_compaction_last_version=12, ob_sysstat_30000=17, ob_sysstat_30002=17, ob_server_resource_cpu_assigned=10, ob_sysstat_30001=17, ob_unit_config_min_cpu=19, process_virtual_memory_max_bytes=10, monagent_oceanbase_plan_timeinfo_cache_size=3, monagent_plugin_execute_total=24, ob_sysstat_30006=17, ob_tenant500_memory_hold_bytes=10, ob_sysstat_30005=17, arbitration_status_inactive_server_count=6, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=12, ob_clog_max_sync_delay_seconds=13, oceanbase_connectivity=12} 2024-06-04 10:50:41.943 WARN 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:41.943 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 69, createErrorCount 65 2024-06-04 10:50:41.943 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 69, createErrorCount 65 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:41.943 INFO 77632 --- [pool-prometheus-minute-schedule-1,3127ef0a99ad4317,2d064fc3af2f] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469437942, count=0, elapsed=4001 2024-06-04 10:50:41.943 INFO 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:42.694 INFO 77632 --- [pool-ocp-async-10,39e1a294164b49c7,01b2cd53b86f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:42.707 WARN 77632 --- [pool-scanner-12476-1,39e1a294164b49c7,ee666ba23e4b] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:42.748 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:42.748 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 874, createErrorCount 65 2024-06-04 10:50:42.748 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:42.879 INFO 77632 --- [pool-ocp-async-2,60046290c1db4017,1df918e1454f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:42.934 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:42.934 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1061, createErrorCount 65 2024-06-04 10:50:42.935 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:42.939 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:42.951 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:43.007 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.007 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1133, createErrorCount 65 2024-06-04 10:50:43.007 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:43.024 WARN 77632 --- [pool-ocp-async-4,c12229be59ca4af7,157c96edf236] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.024 INFO 77632 --- [pool-ocp-async-9,c1ab39a6c66646f8,e480ee8bf058] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:43.024 ERROR 77632 --- [pool-ocp-async-4,c12229be59ca4af7,157c96edf236] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1151, createErrorCount 65 2024-06-04 10:50:43.024 WARN 77632 --- [pool-ocp-async-6,34f4680311f74728,7a2e99c44e11] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:43.025 WARN 77632 --- [pool-ocp-async-5,f2e72f8dcbd14c2e,63e35b40411d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:43.029 WARN 77632 --- [pool-ocp-async-8,d9d14b36fefc4224,d728815f0b4f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.029 ERROR 77632 --- [pool-ocp-async-8,d9d14b36fefc4224,d728815f0b4f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1155, createErrorCount 65 2024-06-04 10:50:43.034 WARN 77632 --- [pool-ocp-async-3,12f480f195b2428c,7f6d80d34098] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.034 ERROR 77632 --- [pool-ocp-async-3,12f480f195b2428c,7f6d80d34098] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1161, createErrorCount 65 2024-06-04 10:50:43.046 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.046 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1172, createErrorCount 65 2024-06-04 10:50:43.046 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObClusterAlarmTarget(ObAlarmTargetProvider.java:76) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1172, createErrorCount 65 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:43.166 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.166 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1292, createErrorCount 65 2024-06-04 10:50:43.166 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:43.303 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.303 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1430, createErrorCount 65 2024-06-04 10:50:43.304 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1430, createErrorCount 65 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:43.769 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:43.769 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1895, createErrorCount 65 2024-06-04 10:50:43.769 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1895, createErrorCount 65 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:43.876 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:43.876 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:43.913 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:43.915 WARN 77632 --- [pool-prometheus-exporter-check1,b21a6bca2b1a4373,87d2dbbd59f3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:43.943 WARN 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.446 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:44.446 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:44.695 WARN 77632 --- [alarm-detect-9,39e1a294164b49c7,7ba566b8e839] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.695 WARN 77632 --- [alarm-detect-30,39e1a294164b49c7,3cd468097d87] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.695 WARN 77632 --- [alarm-detect-18,39e1a294164b49c7,57c566a8440b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-20,39e1a294164b49c7,cbdffe040716] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-27,39e1a294164b49c7,0dc53fa2f0ad] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-7,39e1a294164b49c7,047ecaf07c65] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-29,39e1a294164b49c7,17d30103755e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-2,39e1a294164b49c7,3decd5df77ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-19,39e1a294164b49c7,b9f7846574e0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.697 WARN 77632 --- [alarm-detect-4,39e1a294164b49c7,a4c13aba6664] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-16,39e1a294164b49c7,14076ad1a338] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-24,39e1a294164b49c7,a604903ece67] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-1,39e1a294164b49c7,0bc105dba734] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-3,39e1a294164b49c7,64962ace370a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-28,39e1a294164b49c7,4592e163866b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-11,39e1a294164b49c7,1779aede4c4b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.698 WARN 77632 --- [alarm-detect-5,39e1a294164b49c7,fd1e9a865cfd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.700 WARN 77632 --- [alarm-detect-17,39e1a294164b49c7,d4c53e3cd6f3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.700 WARN 77632 --- [alarm-detect-12,39e1a294164b49c7,6efb800e4b68] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.701 WARN 77632 --- [alarm-detect-8,39e1a294164b49c7,7eb99946d7cf] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.701 WARN 77632 --- [alarm-detect-13,39e1a294164b49c7,42d443e96783] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.701 WARN 77632 --- [alarm-detect-21,39e1a294164b49c7,56c3150ce258] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.703 WARN 77632 --- [alarm-detect-14,39e1a294164b49c7,4c7c68cb31e4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.704 WARN 77632 --- [alarm-detect-15,39e1a294164b49c7,e388787f5fab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.704 WARN 77632 --- [alarm-detect-6,39e1a294164b49c7,fdf711c22289] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.704 WARN 77632 --- [alarm-detect-25,39e1a294164b49c7,67eb7975c3b5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.704 WARN 77632 --- [alarm-detect-22,39e1a294164b49c7,4aa7e7cb13e5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.704 WARN 77632 --- [alarm-detect-23,39e1a294164b49c7,242301897f59] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.706 WARN 77632 --- [alarm-detect-10,39e1a294164b49c7,78d049a3791a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.708 WARN 77632 --- [alarm-detect-26,39e1a294164b49c7,366bbe8a42cc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.861 WARN 77632 --- [pool-overview-container-6,04cb0c530e2a4857,01315e5032fb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.861 WARN 77632 --- [pool-overview-container-8,ee8140afe32b4a0f,7110a74d9142] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.861 WARN 77632 --- [pool-overview-container-4,7b51ca4cdf724187,0dd084ab82d9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.861 WARN 77632 --- [pool-overview-container-2,0b451dc4bd2249c5,9ed8416a89e7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.879 WARN 77632 --- [pool-overview-container-1,62fb962de33344a3,641cb43eea88] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.879 WARN 77632 --- [pool-ocp-async-2,60046290c1db4017,1df918e1454f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.885 WARN 77632 --- [pool-overview-container-5,8181ae809d414382,d17a6fba47ac] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.935 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.939 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:44.939 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 67 2024-06-04 10:50:44.940 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:44.940 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:44.951 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 5, createErrorCount 67 2024-06-04 10:50:45.025 WARN 77632 --- [pool-ocp-async-6,34f4680311f74728,7a2e99c44e11] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.025 ERROR 77632 --- [pool-ocp-async-6,34f4680311f74728,7a2e99c44e11] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 78, createErrorCount 67 2024-06-04 10:50:45.025 INFO 77632 --- [pool-ocp-async-6,aef9787733f248f6,4204ca589dad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:45.025 WARN 77632 --- [pool-ocp-async-5,f2e72f8dcbd14c2e,63e35b40411d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.025 ERROR 77632 --- [pool-ocp-async-5,f2e72f8dcbd14c2e,63e35b40411d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 78, createErrorCount 67 2024-06-04 10:50:45.025 WARN 77632 --- [pool-ocp-async-4,b299710189034b02,af6ce9f121e5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.026 WARN 77632 --- [pool-ocp-async-1,bfbd5727aa64424b,3e522d806f83] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.035 WARN 77632 --- [pool-ocp-async-9,c1ab39a6c66646f8,e480ee8bf058] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.035 WARN 77632 --- [pool-ocp-async-6,aef9787733f248f6,4204ca589dad] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:45.047 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.102 INFO 77632 --- [pool-prometheus-second-schedule-1,bcd4ebefdb3946ef,af1270ae6dbb] c.o.ocp.monitor.OcpMonitorManager : create pull exporter, exporterCount=1, collectTaskCount=1 2024-06-04 10:50:45.708 WARN 77632 --- [pool-ocp-async-10,39e1a294164b49c7,01b2cd53b86f] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:50:45.708 WARN 77632 --- [alarm-detect-30,39e1a294164b49c7,3cd468097d87] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.708 ERROR 77632 --- [alarm-detect-30,39e1a294164b49c7,3cd468097d87] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.709 ERROR 77632 --- [alarm-detect-30,39e1a294164b49c7,3cd468097d87] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_nic_1000m_hwm org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.709 WARN 77632 --- [alarm-detect-19,39e1a294164b49c7,b9f7846574e0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.709 ERROR 77632 --- [alarm-detect-19,39e1a294164b49c7,b9f7846574e0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.710 ERROR 77632 --- [alarm-detect-19,39e1a294164b49c7,b9f7846574e0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=vpc_connect_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.710 WARN 77632 --- [alarm-detect-12,39e1a294164b49c7,6efb800e4b68] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.710 ERROR 77632 --- [alarm-detect-12,39e1a294164b49c7,6efb800e4b68] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.711 ERROR 77632 --- [alarm-detect-12,39e1a294164b49c7,6efb800e4b68] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_keepalived_master_switched org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.711 WARN 77632 --- [alarm-detect-14,39e1a294164b49c7,4c7c68cb31e4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.711 ERROR 77632 --- [alarm-detect-14,39e1a294164b49c7,4c7c68cb31e4] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.711 ERROR 77632 --- [alarm-detect-14,39e1a294164b49c7,4c7c68cb31e4] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_disk_readonly org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.712 WARN 77632 --- [alarm-detect-26,39e1a294164b49c7,366bbe8a42cc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.712 ERROR 77632 --- [alarm-detect-26,39e1a294164b49c7,366bbe8a42cc] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.712 WARN 77632 --- [alarm-detect-18,39e1a294164b49c7,57c566a8440b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.712 ERROR 77632 --- [alarm-detect-18,39e1a294164b49c7,57c566a8440b] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.712 ERROR 77632 --- [alarm-detect-26,39e1a294164b49c7,366bbe8a42cc] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_sync_delay_time_too_long org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.712 ERROR 77632 --- [alarm-detect-18,39e1a294164b49c7,57c566a8440b] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_alarm_detect_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.713 WARN 77632 --- [alarm-detect-10,39e1a294164b49c7,78d049a3791a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.713 ERROR 77632 --- [alarm-detect-10,39e1a294164b49c7,78d049a3791a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.713 ERROR 77632 --- [alarm-detect-10,39e1a294164b49c7,78d049a3791a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.716 WARN 77632 --- [alarm-detect-23,39e1a294164b49c7,242301897f59] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.716 ERROR 77632 --- [alarm-detect-23,39e1a294164b49c7,242301897f59] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.716 ERROR 77632 --- [alarm-detect-23,39e1a294164b49c7,242301897f59] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_merge_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.716 WARN 77632 --- [alarm-detect-9,39e1a294164b49c7,7ba566b8e839] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.716 ERROR 77632 --- [alarm-detect-9,39e1a294164b49c7,7ba566b8e839] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.717 ERROR 77632 --- [alarm-detect-9,39e1a294164b49c7,7ba566b8e839] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_drop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.717 WARN 77632 --- [alarm-detect-22,39e1a294164b49c7,4aa7e7cb13e5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.717 ERROR 77632 --- [alarm-detect-22,39e1a294164b49c7,4aa7e7cb13e5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.717 ERROR 77632 --- [alarm-detect-22,39e1a294164b49c7,4aa7e7cb13e5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=monagent_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.717 WARN 77632 --- [alarm-detect-20,39e1a294164b49c7,cbdffe040716] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.717 ERROR 77632 --- [alarm-detect-20,39e1a294164b49c7,cbdffe040716] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.718 ERROR 77632 --- [alarm-detect-20,39e1a294164b49c7,cbdffe040716] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=mgragent_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.718 WARN 77632 --- [alarm-detect-27,39e1a294164b49c7,0dc53fa2f0ad] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.718 ERROR 77632 --- [alarm-detect-27,39e1a294164b49c7,0dc53fa2f0ad] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.718 ERROR 77632 --- [alarm-detect-27,39e1a294164b49c7,0dc53fa2f0ad] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_nic_1000m_full org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.718 WARN 77632 --- [alarm-detect-7,39e1a294164b49c7,047ecaf07c65] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.719 ERROR 77632 --- [alarm-detect-7,39e1a294164b49c7,047ecaf07c65] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.719 ERROR 77632 --- [alarm-detect-7,39e1a294164b49c7,047ecaf07c65] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_monitordb_disconnected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.719 WARN 77632 --- [alarm-detect-29,39e1a294164b49c7,17d30103755e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.719 ERROR 77632 --- [alarm-detect-29,39e1a294164b49c7,17d30103755e] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.719 ERROR 77632 --- [alarm-detect-29,39e1a294164b49c7,17d30103755e] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxyd_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.720 WARN 77632 --- [alarm-detect-2,39e1a294164b49c7,3decd5df77ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.720 ERROR 77632 --- [alarm-detect-2,39e1a294164b49c7,3decd5df77ab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.720 ERROR 77632 --- [alarm-detect-2,39e1a294164b49c7,3decd5df77ab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_mem_hold_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.720 WARN 77632 --- [alarm-detect-13,39e1a294164b49c7,42d443e96783] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.720 ERROR 77632 --- [alarm-detect-13,39e1a294164b49c7,42d443e96783] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.720 ERROR 77632 --- [alarm-detect-13,39e1a294164b49c7,42d443e96783] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_etcd_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.721 WARN 77632 --- [alarm-detect-17,39e1a294164b49c7,d4c53e3cd6f3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.721 ERROR 77632 --- [alarm-detect-17,39e1a294164b49c7,d4c53e3cd6f3] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.721 ERROR 77632 --- [alarm-detect-17,39e1a294164b49c7,d4c53e3cd6f3] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_leader_switched org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.721 WARN 77632 --- [alarm-detect-4,39e1a294164b49c7,a4c13aba6664] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.721 ERROR 77632 --- [alarm-detect-4,39e1a294164b49c7,a4c13aba6664] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.722 ERROR 77632 --- [alarm-detect-4,39e1a294164b49c7,a4c13aba6664] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_ntp_service_not_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.722 WARN 77632 --- [alarm-detect-16,39e1a294164b49c7,14076ad1a338] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.722 ERROR 77632 --- [alarm-detect-16,39e1a294164b49c7,14076ad1a338] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.722 ERROR 77632 --- [alarm-detect-16,39e1a294164b49c7,14076ad1a338] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=standby_tenant_sync_status_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.722 WARN 77632 --- [alarm-detect-24,39e1a294164b49c7,a604903ece67] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.722 ERROR 77632 --- [alarm-detect-24,39e1a294164b49c7,a604903ece67] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.723 ERROR 77632 --- [alarm-detect-24,39e1a294164b49c7,a604903ece67] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_task_timeout org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.723 WARN 77632 --- [alarm-detect-1,39e1a294164b49c7,0bc105dba734] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.723 ERROR 77632 --- [alarm-detect-1,39e1a294164b49c7,0bc105dba734] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.723 ERROR 77632 --- [alarm-detect-1,39e1a294164b49c7,0bc105dba734] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_sys_abnormal org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.724 WARN 77632 --- [alarm-detect-3,39e1a294164b49c7,64962ace370a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.724 ERROR 77632 --- [alarm-detect-3,39e1a294164b49c7,64962ace370a] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.724 ERROR 77632 --- [alarm-detect-3,39e1a294164b49c7,64962ace370a] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_invalid_disk_exists org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.724 WARN 77632 --- [alarm-detect-21,39e1a294164b49c7,56c3150ce258] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.724 ERROR 77632 --- [alarm-detect-21,39e1a294164b49c7,56c3150ce258] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.725 ERROR 77632 --- [alarm-detect-21,39e1a294164b49c7,56c3150ce258] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_exists_inactive_server org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.725 WARN 77632 --- [alarm-detect-28,39e1a294164b49c7,4592e163866b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.725 ERROR 77632 --- [alarm-detect-28,39e1a294164b49c7,4592e163866b] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.725 ERROR 77632 --- [alarm-detect-28,39e1a294164b49c7,4592e163866b] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_tcp_retrans_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.725 WARN 77632 --- [alarm-detect-25,39e1a294164b49c7,67eb7975c3b5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.725 ERROR 77632 --- [alarm-detect-25,39e1a294164b49c7,67eb7975c3b5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.726 ERROR 77632 --- [alarm-detect-25,39e1a294164b49c7,67eb7975c3b5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.726 WARN 77632 --- [alarm-detect-11,39e1a294164b49c7,1779aede4c4b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.726 ERROR 77632 --- [alarm-detect-11,39e1a294164b49c7,1779aede4c4b] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.726 ERROR 77632 --- [alarm-detect-11,39e1a294164b49c7,1779aede4c4b] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_load1_per_cpu_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.727 WARN 77632 --- [alarm-detect-6,39e1a294164b49c7,fdf711c22289] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.727 ERROR 77632 --- [alarm-detect-6,39e1a294164b49c7,fdf711c22289] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.727 ERROR 77632 --- [alarm-detect-6,39e1a294164b49c7,fdf711c22289] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_meta_db_disconnected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.727 WARN 77632 --- [alarm-detect-15,39e1a294164b49c7,e388787f5fab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.727 ERROR 77632 --- [alarm-detect-15,39e1a294164b49c7,e388787f5fab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.728 ERROR 77632 --- [alarm-detect-15,39e1a294164b49c7,e388787f5fab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ocp_http_request_too_many_errors_occur org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.728 WARN 77632 --- [alarm-detect-5,39e1a294164b49c7,fd1e9a865cfd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.728 ERROR 77632 --- [alarm-detect-5,39e1a294164b49c7,fd1e9a865cfd] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.728 ERROR 77632 --- [alarm-detect-5,39e1a294164b49c7,fd1e9a865cfd] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxy_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.728 WARN 77632 --- [alarm-detect-8,39e1a294164b49c7,7eb99946d7cf] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.728 ERROR 77632 --- [alarm-detect-8,39e1a294164b49c7,7eb99946d7cf] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:50:45.729 ERROR 77632 --- [alarm-detect-8,39e1a294164b49c7,7eb99946d7cf] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_compaction_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:50:45.816 INFO 77632 --- [pool-ocp-schedules-17,d028f5bf1db14f63,816950f655fd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:50:45.913 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.913 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 966, createErrorCount 67 2024-06-04 10:50:45.913 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 966, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:45.916 WARN 77632 --- [pool-prometheus-exporter-check1,b21a6bca2b1a4373,87d2dbbd59f3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.916 ERROR 77632 --- [pool-prometheus-exporter-check1,b21a6bca2b1a4373,87d2dbbd59f3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 969, createErrorCount 67 2024-06-04 10:50:45.916 ERROR 77632 --- [pool-prometheus-exporter-check1,b21a6bca2b1a4373,87d2dbbd59f3] c.o.ocp.monitor.OcpMonitorManager : checkActiveExporters failed: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.getAllExporterIdsWithSwitchOn(OcpExporterServiceImpl.java:178) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkActive(OcpExporterStatusCheckServiceImpl.java:87) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$3(OcpMonitorManager.java:144) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 969, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:45.922 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.935 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:45.944 WARN 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:45.944 ERROR 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 997, createErrorCount 67 2024-06-04 10:50:45.944 ERROR 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 997, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:45.944 INFO 77632 --- [pool-prometheus-minute-schedule-1,506b2bb49126472c,08d252d6de64] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469441943, count=0, elapsed=4001 2024-06-04 10:50:45.945 INFO 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:46.007 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:46.110 INFO 77632 --- [pool-metric-parse-12,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469445, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:50:46.166 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:46.304 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:46.304 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:46.770 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:46.861 WARN 77632 --- [pool-overview-container-6,04cb0c530e2a4857,01315e5032fb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.861 WARN 77632 --- [pool-overview-container-8,ee8140afe32b4a0f,7110a74d9142] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.861 WARN 77632 --- [pool-overview-container-2,0b451dc4bd2249c5,9ed8416a89e7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.861 ERROR 77632 --- [pool-overview-container-8,ee8140afe32b4a0f,7110a74d9142] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 2024-06-04 10:50:46.861 ERROR 77632 --- [pool-overview-container-6,04cb0c530e2a4857,01315e5032fb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1914, createErrorCount 67 2024-06-04 10:50:46.861 ERROR 77632 --- [pool-overview-container-2,0b451dc4bd2249c5,9ed8416a89e7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 2024-06-04 10:50:46.862 WARN 77632 --- [pool-overview-container-4,7b51ca4cdf724187,0dd084ab82d9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.862 ERROR 77632 --- [pool-overview-container-4,7b51ca4cdf724187,0dd084ab82d9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 2024-06-04 10:50:46.862 ERROR 77632 --- [pool-overview-container-8,ee8140afe32b4a0f,7110a74d9142] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 ERROR 77632 --- [pool-overview-container-2,0b451dc4bd2249c5,9ed8416a89e7] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 ERROR 77632 --- [pool-overview-container-4,7b51ca4cdf724187,0dd084ab82d9] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 WARN 77632 --- [pool-overview-container-8,ee8140afe32b4a0f,7110a74d9142] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 WARN 77632 --- [pool-overview-container-2,0b451dc4bd2249c5,9ed8416a89e7] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 WARN 77632 --- [pool-overview-container-4,7b51ca4cdf724187,0dd084ab82d9] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1915, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.862 ERROR 77632 --- [pool-overview-container-6,04cb0c530e2a4857,01315e5032fb] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1914, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.863 WARN 77632 --- [pool-overview-container-6,04cb0c530e2a4857,01315e5032fb] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1914, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.879 WARN 77632 --- [pool-overview-container-1,62fb962de33344a3,641cb43eea88] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.879 WARN 77632 --- [pool-ocp-async-2,60046290c1db4017,1df918e1454f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.879 ERROR 77632 --- [pool-ocp-async-2,60046290c1db4017,1df918e1454f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 67 2024-06-04 10:50:46.879 ERROR 77632 --- [pool-overview-container-1,62fb962de33344a3,641cb43eea88] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 67 2024-06-04 10:50:46.880 ERROR 77632 --- [pool-overview-container-1,62fb962de33344a3,641cb43eea88] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.880 WARN 77632 --- [pool-overview-container-1,62fb962de33344a3,641cb43eea88] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.885 WARN 77632 --- [pool-overview-container-5,8181ae809d414382,d17a6fba47ac] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.885 ERROR 77632 --- [pool-overview-container-5,8181ae809d414382,d17a6fba47ac] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1938, createErrorCount 67 2024-06-04 10:50:46.885 ERROR 77632 --- [pool-overview-container-5,8181ae809d414382,d17a6fba47ac] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1938, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.886 WARN 77632 --- [pool-overview-container-5,8181ae809d414382,d17a6fba47ac] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1938, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.935 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:46.935 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1988, createErrorCount 67 2024-06-04 10:50:46.937 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1988, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.940 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1994, createErrorCount 67 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1994, createErrorCount 67 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.941 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:46.949 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.949 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:46.952 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:47.025 INFO 77632 --- [pool-ocp-async-6,257f85c19d944ccd,da3145dd2356] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:47.025 WARN 77632 --- [pool-ocp-async-3,35d21d747e9e4ac6,8c7ae58040b2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:47.025 WARN 77632 --- [pool-ocp-async-4,b299710189034b02,af6ce9f121e5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.025 ERROR 77632 --- [pool-ocp-async-4,b299710189034b02,af6ce9f121e5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 68 2024-06-04 10:50:47.026 WARN 77632 --- [pool-ocp-async-1,bfbd5727aa64424b,3e522d806f83] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.026 ERROR 77632 --- [pool-ocp-async-1,bfbd5727aa64424b,3e522d806f83] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 68 2024-06-04 10:50:47.027 WARN 77632 --- [pool-ocp-async-8,0d4b56017d8c4cf6,24868d17a536] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:47.035 WARN 77632 --- [pool-ocp-async-9,c1ab39a6c66646f8,e480ee8bf058] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.035 ERROR 77632 --- [pool-ocp-async-9,c1ab39a6c66646f8,e480ee8bf058] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 68 2024-06-04 10:50:47.035 WARN 77632 --- [pool-ocp-async-6,257f85c19d944ccd,da3145dd2356] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:47.047 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.047 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 68 2024-06-04 10:50:47.048 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObTenantAlarmTarget(ObAlarmTargetProvider.java:110) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 46 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 68 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 50 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:47.478 WARN 77632 --- [pool-ocp-schedules-5,5dced8dd584f499c,010af4244b49] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:47.517 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:47.517 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:47.816 WARN 77632 --- [pool-ocp-schedules-17,d028f5bf1db14f63,816950f655fd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:47.922 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.922 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 69 2024-06-04 10:50:47.923 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:47.935 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:47.935 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 69 2024-06-04 10:50:47.935 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:47.945 WARN 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:48.007 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:48.008 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 69 2024-06-04 10:50:48.008 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:48.166 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:48.167 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 149, createErrorCount 69 2024-06-04 10:50:48.167 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:48.281 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:48.304 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:48.304 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 286, createErrorCount 69 2024-06-04 10:50:48.305 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 286, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:48.305 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 287, createErrorCount 69 2024-06-04 10:50:48.324 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:48.770 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:48.770 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 752, createErrorCount 69 2024-06-04 10:50:48.770 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 752, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:48.917 WARN 77632 --- [pool-prometheus-exporter-check2,748fbaa6381b409b,1ac6128b3e56] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:48.952 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 934, createErrorCount 69 2024-06-04 10:50:49.025 WARN 77632 --- [pool-ocp-async-7,4fb4ed6a89e94037,a7ed7ff0d9e6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:49.025 INFO 77632 --- [pool-ocp-async-4,fda9ba4c77184066,1a8e88a80db1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:49.026 WARN 77632 --- [pool-ocp-async-3,35d21d747e9e4ac6,8c7ae58040b2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:49.026 ERROR 77632 --- [pool-ocp-async-3,35d21d747e9e4ac6,8c7ae58040b2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1008, createErrorCount 69 2024-06-04 10:50:49.026 WARN 77632 --- [pool-ocp-async-10,9ea4b99e80914fe9,379d7f400c24] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:49.027 WARN 77632 --- [pool-ocp-async-8,0d4b56017d8c4cf6,24868d17a536] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:49.027 ERROR 77632 --- [pool-ocp-async-8,0d4b56017d8c4cf6,24868d17a536] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1009, createErrorCount 69 2024-06-04 10:50:49.048 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:49.479 WARN 77632 --- [pool-ocp-schedules-5,5dced8dd584f499c,010af4244b49] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:49.479 ERROR 77632 --- [pool-ocp-schedules-5,5dced8dd584f499c,010af4244b49] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1461, createErrorCount 69 2024-06-04 10:50:49.479 ERROR 77632 --- [pool-ocp-schedules-5,5dced8dd584f499c,010af4244b49] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1461, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:49.749 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:49.817 WARN 77632 --- [pool-ocp-schedules-17,d028f5bf1db14f63,816950f655fd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:49.817 ERROR 77632 --- [pool-ocp-schedules-17,d028f5bf1db14f63,816950f655fd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1799, createErrorCount 69 2024-06-04 10:50:49.817 ERROR 77632 --- [pool-ocp-schedules-17,d028f5bf1db14f63,816950f655fd] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1799, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:49.940 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:49.950 WARN 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:49.950 ERROR 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 69 2024-06-04 10:50:49.950 ERROR 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 1932, createErrorCount 69 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:49.950 INFO 77632 --- [pool-prometheus-minute-schedule-1,d3cf85ae52d74573,974449e1710f] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469445945, count=0, elapsed=4005 2024-06-04 10:50:49.950 INFO 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:50.020 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:50.020 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:50.281 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:50.281 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 70 2024-06-04 10:50:50.281 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:50.324 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:50.324 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 70 2024-06-04 10:50:50.324 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:50.590 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:50.590 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:50.707 WARN 77632 --- [pool-ocp-schedules-12,f71fadac1e2648c6,725349c9b431] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:50.914 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:50.918 WARN 77632 --- [pool-prometheus-exporter-check2,748fbaa6381b409b,1ac6128b3e56] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:50.918 ERROR 77632 --- [pool-prometheus-exporter-check2,748fbaa6381b409b,1ac6128b3e56] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 2024-06-04 10:50:50.918 ERROR 77632 --- [pool-prometheus-exporter-check2,748fbaa6381b409b,1ac6128b3e56] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 27 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:50.935 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:50.952 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.008 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.025 WARN 77632 --- [pool-ocp-async-7,4fb4ed6a89e94037,a7ed7ff0d9e6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:51.025 ERROR 77632 --- [pool-ocp-async-7,4fb4ed6a89e94037,a7ed7ff0d9e6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 2024-06-04 10:50:51.025 WARN 77632 --- [pool-ocp-async-4,fda9ba4c77184066,1a8e88a80db1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.025 INFO 77632 --- [pool-ocp-async-6,3b817562463d4a74,a1c4c3173c0a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:51.025 WARN 77632 --- [pool-ocp-async-1,760e6ca652d44136,7c6392591ee2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.026 WARN 77632 --- [pool-ocp-async-10,9ea4b99e80914fe9,379d7f400c24] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:51.026 WARN 77632 --- [pool-ocp-async-2,e4f267c241434f77,778643f5b096] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.026 ERROR 77632 --- [pool-ocp-async-10,9ea4b99e80914fe9,379d7f400c24] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 2024-06-04 10:50:51.035 WARN 77632 --- [pool-ocp-async-6,3b817562463d4a74,a1c4c3173c0a] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:51.048 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:51.048 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 2024-06-04 10:50:51.049 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObServerAlarmTarget(ObAlarmTargetProvider.java:164) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 71 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:51.167 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.305 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.749 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:51.749 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 658, createErrorCount 71 2024-06-04 10:50:51.749 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:50:51.771 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.937 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.941 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:51.941 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 850, createErrorCount 71 2024-06-04 10:50:51.941 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 850, createErrorCount 71 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:51.941 WARN 77632 --- [pool-7-thread-2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:51.950 WARN 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:52.694 INFO 77632 --- [pool-ocp-async-3,4be7de5e9f0c4fe1,5afb7da6965f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:50:52.700 WARN 77632 --- [pool-scanner-12492-1,4be7de5e9f0c4fe1,27220c11349a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:50:52.708 WARN 77632 --- [pool-ocp-schedules-12,f71fadac1e2648c6,725349c9b431] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:52.708 ERROR 77632 --- [pool-ocp-schedules-12,f71fadac1e2648c6,725349c9b431] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1617, createErrorCount 71 2024-06-04 10:50:52.711 ERROR 77632 --- [pool-ocp-schedules-12,f71fadac1e2648c6,725349c9b431] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1617, createErrorCount 71 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:52.879 INFO 77632 --- [pool-ocp-async-8,4aff12a5f3604265,c58b4fa014bd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:50:52.914 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:52.914 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1824, createErrorCount 71 2024-06-04 10:50:52.915 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1824, createErrorCount 71 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:52.923 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:52.936 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:52.936 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1845, createErrorCount 71 2024-06-04 10:50:52.936 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:52.952 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1861, createErrorCount 71 2024-06-04 10:50:53.008 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.008 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1917, createErrorCount 71 2024-06-04 10:50:53.008 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:53.025 INFO 77632 --- [pool-ocp-async-3,df7d36399b5c49c4,07b18b9a70cc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:53.025 WARN 77632 --- [pool-ocp-async-4,fda9ba4c77184066,1a8e88a80db1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.025 ERROR 77632 --- [pool-ocp-async-4,fda9ba4c77184066,1a8e88a80db1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1935, createErrorCount 71 2024-06-04 10:50:53.025 WARN 77632 --- [pool-ocp-async-1,760e6ca652d44136,7c6392591ee2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.025 ERROR 77632 --- [pool-ocp-async-1,760e6ca652d44136,7c6392591ee2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1935, createErrorCount 71 2024-06-04 10:50:53.026 WARN 77632 --- [pool-ocp-async-9,bc1e5cee28974064,7b713c721acb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:53.026 WARN 77632 --- [pool-ocp-async-2,e4f267c241434f77,778643f5b096] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.026 ERROR 77632 --- [pool-ocp-async-2,e4f267c241434f77,778643f5b096] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1936, createErrorCount 71 2024-06-04 10:50:53.026 WARN 77632 --- [pool-ocp-async-5,d60943a1c9b84e32,61be6a43a000] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:53.051 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:53.093 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.093 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.167 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.167 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 72 2024-06-04 10:50:53.167 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:53.305 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.305 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 72 2024-06-04 10:50:53.305 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 72 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.661 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.661 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.771 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.771 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 2024-06-04 10:50:53.771 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.938 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.938 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 2024-06-04 10:50:53.938 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.941 WARN 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.942 INFO 77632 --- [pool-7-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:50:53.951 WARN 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:53.951 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 2024-06-04 10:50:53.951 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:53.951 INFO 77632 --- [pool-prometheus-minute-schedule-1,3f71b5ee0dfd43c3,99797c22d3a0] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469449950, count=0, elapsed=4001 2024-06-04 10:50:53.951 INFO 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:54.682 WARN 77632 --- [pool-ocp-schedules-7,f29d3f544da2493a,96bab0f00264] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.687 WARN 77632 --- [pool-ocp-schedules-3,b9dd518d76c44434,a3138e136d0c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.687 WARN 77632 --- [pool-ocp-schedules-6,29725518b9ad4f8a,a7bafd454e68] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.689 WARN 77632 --- [pool-ocp-schedules-5,a62731fc1491420c,2b5003c39fba] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.690 WARN 77632 --- [pool-ocp-schedules-13,f12349b351854c3a,40017401ab12] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.690 WARN 77632 --- [pool-ocp-schedules-17,fa1b2e8ed9fc4a61,5f7322419b5a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.691 WARN 77632 --- [pool-ocp-schedules-15,5765511351fa41df,6102018cad96] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.692 WARN 77632 --- [pool-ocp-schedules-9,841c3ef2461a4100,b5e29abc28f2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.692 WARN 77632 --- [pool-ocp-schedules-18,491803d3e41941ac,b0ef454f671c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.694 WARN 77632 --- [pool-ocp-async-7,afe84b70eda546d3,8cbf65243feb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.694 WARN 77632 --- [pool-ocp-async-10,b53b1ba0c70a4d65,32feef3db48c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.694 WARN 77632 --- [pool-ocp-async-6,63a0bf9fc3a2460b,83d7a590644b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.726 WARN 77632 --- [pool-ocp-schedules-11,f1e185d128d849d0,80059eb651e1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.732 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.861 WARN 77632 --- [pool-overview-container-3,0099d0b26981435e,4fdaaaca27b9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.861 WARN 77632 --- [pool-overview-container-7,693a3e0346954da9,5e2d91e51df1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.863 WARN 77632 --- [pool-overview-container-8,8e367baa3a2b46e6,c6745eb1866a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.863 WARN 77632 --- [pool-overview-container-2,ab23c0fba5c94a44,f2d211eeb5b6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.879 WARN 77632 --- [pool-ocp-async-8,4aff12a5f3604265,c58b4fa014bd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.879 WARN 77632 --- [pool-overview-container-4,c904cb0673c349da,58997ebd3acc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.885 WARN 77632 --- [pool-overview-container-6,773e56f21d42468a,b38b489f9274] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:54.923 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:54.924 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 762, createErrorCount 73 2024-06-04 10:50:54.924 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 762, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:54.952 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.025 INFO 77632 --- [pool-ocp-async-2,8b7cbb113c814fdd,57d637dcb7a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:55.026 WARN 77632 --- [pool-ocp-async-3,df7d36399b5c49c4,07b18b9a70cc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.026 WARN 77632 --- [pool-ocp-async-4,e874b3f7aa144a63,acea54fcb838] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.026 WARN 77632 --- [pool-ocp-async-9,bc1e5cee28974064,7b713c721acb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:55.026 ERROR 77632 --- [pool-ocp-async-9,bc1e5cee28974064,7b713c721acb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 864, createErrorCount 73 2024-06-04 10:50:55.026 WARN 77632 --- [pool-ocp-async-1,3190df5f1d744e4a,d13654d0621c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.026 WARN 77632 --- [pool-ocp-async-5,d60943a1c9b84e32,61be6a43a000] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:55.026 ERROR 77632 --- [pool-ocp-async-5,d60943a1c9b84e32,61be6a43a000] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 865, createErrorCount 73 2024-06-04 10:50:55.036 WARN 77632 --- [pool-ocp-async-2,8b7cbb113c814fdd,57d637dcb7a2] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:55.051 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:55.051 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 889, createErrorCount 73 2024-06-04 10:50:55.052 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listAllClusters(ClusterServiceImpl.java:482) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters0(ClusterServiceImpl.java:312) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listClusters(ClusterServiceImpl.java:293) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listClusters() at com.oceanbase.ocp.service.ob.ObAlarmTargetProvider.buildObServerLogAlarmTarget(ObAlarmTargetProvider.java:171) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 41 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 889, createErrorCount 73 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 83 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:55.591 WARN 77632 --- [pool-ocp-schedules-8,14f827060e0d41be,20519e2326d9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.936 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:55.952 WARN 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.008 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.163 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.164 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.168 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.306 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.682 WARN 77632 --- [pool-ocp-schedules-7,f29d3f544da2493a,96bab0f00264] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.682 ERROR 77632 --- [pool-ocp-schedules-7,f29d3f544da2493a,96bab0f00264] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 18, createErrorCount 74 2024-06-04 10:50:56.683 ERROR 77632 --- [pool-ocp-schedules-7,f29d3f544da2493a,96bab0f00264] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy298.findByKeyAndApplicationAndProfileAndLabel(Unknown Source) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:191) at com.oceanbase.ocp.core.property.PropertyService.getProperty(PropertyService.java:186) at com.oceanbase.ocp.service.audit.AuditEventService.enableAudit(AuditEventService.java:306) at com.oceanbase.ocp.service.audit.AuditEventService.refreshMethodToAuditEventMetaMap(AuditEventService.java:313) at com.oceanbase.ocp.service.audit.AuditEventService$$FastClassBySpringCGLIB$$cf41526c.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.audit.AuditEventService$$EnhancerBySpringCGLIB$$b5127495.refreshMethodToAuditEventMetaMap() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 31 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 18, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.687 WARN 77632 --- [pool-ocp-schedules-3,b9dd518d76c44434,a3138e136d0c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.688 ERROR 77632 --- [pool-ocp-schedules-3,b9dd518d76c44434,a3138e136d0c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 24, createErrorCount 74 2024-06-04 10:50:56.688 ERROR 77632 --- [pool-ocp-schedules-3,b9dd518d76c44434,a3138e136d0c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 24, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.688 WARN 77632 --- [pool-ocp-schedules-6,29725518b9ad4f8a,a7bafd454e68] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.688 ERROR 77632 --- [pool-ocp-schedules-6,29725518b9ad4f8a,a7bafd454e68] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 24, createErrorCount 74 2024-06-04 10:50:56.688 ERROR 77632 --- [pool-ocp-schedules-6,29725518b9ad4f8a,a7bafd454e68] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 24, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.689 WARN 77632 --- [pool-ocp-schedules-5,a62731fc1491420c,2b5003c39fba] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.689 ERROR 77632 --- [pool-ocp-schedules-5,a62731fc1491420c,2b5003c39fba] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 26, createErrorCount 74 2024-06-04 10:50:56.690 ERROR 77632 --- [pool-ocp-schedules-5,a62731fc1491420c,2b5003c39fba] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 26, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.690 WARN 77632 --- [pool-ocp-schedules-13,f12349b351854c3a,40017401ab12] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.690 ERROR 77632 --- [pool-ocp-schedules-13,f12349b351854c3a,40017401ab12] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 27, createErrorCount 74 2024-06-04 10:50:56.690 WARN 77632 --- [pool-ocp-schedules-17,fa1b2e8ed9fc4a61,5f7322419b5a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.690 ERROR 77632 --- [pool-ocp-schedules-17,fa1b2e8ed9fc4a61,5f7322419b5a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 27, createErrorCount 74 2024-06-04 10:50:56.691 ERROR 77632 --- [pool-ocp-schedules-13,f12349b351854c3a,40017401ab12] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 27, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.691 ERROR 77632 --- [pool-ocp-schedules-17,fa1b2e8ed9fc4a61,5f7322419b5a] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 27, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.691 WARN 77632 --- [pool-ocp-schedules-15,5765511351fa41df,6102018cad96] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.691 ERROR 77632 --- [pool-ocp-schedules-15,5765511351fa41df,6102018cad96] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 2024-06-04 10:50:56.692 ERROR 77632 --- [pool-ocp-schedules-15,5765511351fa41df,6102018cad96] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.692 WARN 77632 --- [pool-ocp-schedules-9,841c3ef2461a4100,b5e29abc28f2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.692 ERROR 77632 --- [pool-ocp-schedules-9,841c3ef2461a4100,b5e29abc28f2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 2024-06-04 10:50:56.692 WARN 77632 --- [pool-ocp-schedules-18,491803d3e41941ac,b0ef454f671c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.692 ERROR 77632 --- [pool-ocp-schedules-18,491803d3e41941ac,b0ef454f671c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 2024-06-04 10:50:56.692 ERROR 77632 --- [pool-ocp-schedules-9,841c3ef2461a4100,b5e29abc28f2] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.692 ERROR 77632 --- [pool-ocp-schedules-18,491803d3e41941ac,b0ef454f671c] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 28, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.694 WARN 77632 --- [pool-ocp-async-7,afe84b70eda546d3,8cbf65243feb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.694 ERROR 77632 --- [pool-ocp-async-7,afe84b70eda546d3,8cbf65243feb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 30, createErrorCount 74 2024-06-04 10:50:56.694 WARN 77632 --- [pool-ocp-async-10,b53b1ba0c70a4d65,32feef3db48c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.694 ERROR 77632 --- [pool-ocp-async-10,b53b1ba0c70a4d65,32feef3db48c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 30, createErrorCount 74 2024-06-04 10:50:56.694 WARN 77632 --- [pool-ocp-async-6,63a0bf9fc3a2460b,83d7a590644b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.694 ERROR 77632 --- [pool-ocp-async-6,63a0bf9fc3a2460b,83d7a590644b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 30, createErrorCount 74 2024-06-04 10:50:56.694 WARN 77632 --- [pool-ocp-async-10,b53b1ba0c70a4d65,32feef3db48c] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy392.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmSubscriptionService.listAll(OcpAlarmSubscriptionService.java:406) at com.oceanbase.ocp.alarm.core.notification.AlarmStatisticsService.doScheduleTask(AlarmStatisticsService.java:129) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier.doStatisticsSchedule(AlarmNotifier.java:304) at com.oceanbase.ocp.alarm.schedule.AlarmNotifier$$FastClassBySpringCGLIB$$ca38577b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 30, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.726 WARN 77632 --- [pool-ocp-schedules-11,f1e185d128d849d0,80059eb651e1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.726 ERROR 77632 --- [pool-ocp-schedules-11,f1e185d128d849d0,80059eb651e1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 62, createErrorCount 74 2024-06-04 10:50:56.729 ERROR 77632 --- [pool-ocp-schedules-11,f1e185d128d849d0,80059eb651e1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy421.queryBackupAlarmTargetStat(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.refreshAlarmStat(OcpAlarmSearchService.java:354) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshBackupAlarmStat(AlarmSchedules.java:99) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 62, createErrorCount 74 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.732 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] c.o.o.s.c.m.InnerExporterServiceImpl : Failed to collect ocp self-metrics org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 67, createErrorCount 68 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:818) at org.springframework.jdbc.core.JdbcTemplate.queryForList(JdbcTemplate.java:935) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.querySeriesId(SeriesKeyIdPersistent.java:44) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.querySeriesId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.queryAndStoreToCache(SeriesIdKeyService.java:106) at com.oceanbase.ocp.monitor.service.IdKeyService.getId(IdKeyService.java:68) at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.getSeriesId(SeriesIdKeyService.java:89) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.mapMetricLines(RollupMetricDataStore.java:105) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.store(RollupMetricDataStore.java:86) at com.oceanbase.ocp.server.common.metrics.InnerExporterServiceImpl.collect(InnerExporterServiceImpl.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 67, createErrorCount 68 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.734 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.734 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.772 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.861 WARN 77632 --- [pool-overview-container-3,0099d0b26981435e,4fdaaaca27b9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.861 ERROR 77632 --- [pool-overview-container-3,0099d0b26981435e,4fdaaaca27b9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.862 ERROR 77632 --- [pool-overview-container-3,0099d0b26981435e,4fdaaaca27b9] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.862 WARN 77632 --- [pool-overview-container-3,0099d0b26981435e,4fdaaaca27b9] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.863 WARN 77632 --- [pool-overview-container-7,693a3e0346954da9,5e2d91e51df1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-7,693a3e0346954da9,5e2d91e51df1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.864 WARN 77632 --- [pool-overview-container-8,8e367baa3a2b46e6,c6745eb1866a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-8,8e367baa3a2b46e6,c6745eb1866a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.864 WARN 77632 --- [pool-overview-container-2,ab23c0fba5c94a44,f2d211eeb5b6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-2,ab23c0fba5c94a44,f2d211eeb5b6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-8,8e367baa3a2b46e6,c6745eb1866a] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-2,ab23c0fba5c94a44,f2d211eeb5b6] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.864 ERROR 77632 --- [pool-overview-container-7,693a3e0346954da9,5e2d91e51df1] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.864 WARN 77632 --- [pool-overview-container-8,8e367baa3a2b46e6,c6745eb1866a] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.864 WARN 77632 --- [pool-overview-container-2,ab23c0fba5c94a44,f2d211eeb5b6] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.864 WARN 77632 --- [pool-overview-container-7,693a3e0346954da9,5e2d91e51df1] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.879 WARN 77632 --- [pool-overview-container-4,c904cb0673c349da,58997ebd3acc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.879 WARN 77632 --- [pool-ocp-async-8,4aff12a5f3604265,c58b4fa014bd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.879 ERROR 77632 --- [pool-overview-container-4,c904cb0673c349da,58997ebd3acc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.879 ERROR 77632 --- [pool-ocp-async-8,4aff12a5f3604265,c58b4fa014bd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.880 ERROR 77632 --- [pool-overview-container-4,c904cb0673c349da,58997ebd3acc] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.880 WARN 77632 --- [pool-overview-container-4,c904cb0673c349da,58997ebd3acc] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.885 WARN 77632 --- [pool-overview-container-6,773e56f21d42468a,b38b489f9274] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:56.885 ERROR 77632 --- [pool-overview-container-6,773e56f21d42468a,b38b489f9274] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:56.885 ERROR 77632 --- [pool-overview-container-6,773e56f21d42468a,b38b489f9274] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.886 WARN 77632 --- [pool-overview-container-6,773e56f21d42468a,b38b489f9274] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:56.942 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:56.953 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:57.026 INFO 77632 --- [pool-ocp-async-10,a292d1a4d2664eea,9cd09868b187] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:57.026 WARN 77632 --- [pool-ocp-async-3,df7d36399b5c49c4,07b18b9a70cc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.026 ERROR 77632 --- [pool-ocp-async-3,df7d36399b5c49c4,07b18b9a70cc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:57.026 WARN 77632 --- [pool-ocp-async-4,e874b3f7aa144a63,acea54fcb838] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.026 ERROR 77632 --- [pool-ocp-async-4,e874b3f7aa144a63,acea54fcb838] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:57.026 WARN 77632 --- [pool-ocp-async-9,4b20ac168eb14342,f469c13e5d45] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.026 WARN 77632 --- [pool-ocp-async-1,3190df5f1d744e4a,d13654d0621c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.027 ERROR 77632 --- [pool-ocp-async-1,3190df5f1d744e4a,d13654d0621c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 75 2024-06-04 10:50:57.027 WARN 77632 --- [pool-ocp-async-5,22f7d30b7f5a4186,5da249571fb9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.052 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.281 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.324 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.591 WARN 77632 --- [pool-ocp-schedules-8,14f827060e0d41be,20519e2326d9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.591 ERROR 77632 --- [pool-ocp-schedules-8,14f827060e0d41be,20519e2326d9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 356, createErrorCount 75 2024-06-04 10:50:57.592 ERROR 77632 --- [pool-ocp-schedules-8,14f827060e0d41be,20519e2326d9] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 356, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:57.916 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:57.936 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.936 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 701, createErrorCount 75 2024-06-04 10:50:57.936 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:50:57.952 WARN 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:57.952 ERROR 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 717, createErrorCount 75 2024-06-04 10:50:57.952 ERROR 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 717, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:57.953 INFO 77632 --- [pool-prometheus-minute-schedule-1,008bb04c27ff4ba6,30adf2fe86bc] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469453951, count=0, elapsed=4002 2024-06-04 10:50:57.953 INFO 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469460, interval=60 2024-06-04 10:50:58.009 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:58.009 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 774, createErrorCount 75 2024-06-04 10:50:58.009 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:50:58.168 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:58.168 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 933, createErrorCount 75 2024-06-04 10:50:58.168 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:50:58.306 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:58.306 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1071, createErrorCount 75 2024-06-04 10:50:58.306 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1071, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:58.749 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:58.772 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:58.772 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1537, createErrorCount 75 2024-06-04 10:50:58.772 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1537, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:58.939 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:58.942 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:58.942 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1707, createErrorCount 75 2024-06-04 10:50:58.942 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1707, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:58.943 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:58.953 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:59.026 INFO 77632 --- [pool-ocp-async-8,794e187df3fc478c,eac4dddd5748] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:50:59.026 WARN 77632 --- [pool-ocp-async-2,1f1b3bf9027a4fce,c7392a6d9dcd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:59.026 WARN 77632 --- [pool-ocp-async-10,a292d1a4d2664eea,9cd09868b187] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:59.026 WARN 77632 --- [pool-ocp-async-9,4b20ac168eb14342,f469c13e5d45] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.026 ERROR 77632 --- [pool-ocp-async-9,4b20ac168eb14342,f469c13e5d45] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1791, createErrorCount 75 2024-06-04 10:50:59.026 WARN 77632 --- [pool-ocp-async-7,5ee3cd2ec52e4bce,12d8d611171c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:59.027 WARN 77632 --- [pool-ocp-async-5,22f7d30b7f5a4186,5da249571fb9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.027 ERROR 77632 --- [pool-ocp-async-5,22f7d30b7f5a4186,5da249571fb9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1792, createErrorCount 75 2024-06-04 10:50:59.036 WARN 77632 --- [pool-ocp-async-8,794e187df3fc478c,eac4dddd5748] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:50:59.052 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.052 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1817, createErrorCount 75 2024-06-04 10:50:59.053 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyClusterAlarmTarget(ObproxyAlarmTargetProvider.java:55) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1817, createErrorCount 75 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.237 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.237 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.282 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.282 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 76 2024-06-04 10:50:59.282 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:50:59.324 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.324 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 76 2024-06-04 10:50:59.325 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:50:59.805 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.805 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.817 INFO 77632 --- [pool-ocp-schedules-18,02ee5eba725e4adf,ab564f574b05] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:50:59.916 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:50:59.916 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 77 2024-06-04 10:50:59.916 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 77 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:50:59.925 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:50:59.953 WARN 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:00.000 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.s.task.scheduled.OcpSchedules : Refresh OCP properties. 2024-06-04 10:51:00.000 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-06-04 10:51:00.003 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-06-04 10:51:00.003 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : init spring 2024-06-04 10:51:00.003 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-06-04 10:51:00.003 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : starting 2024-06-04 10:51:00.006 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-06-04 10:51:00.006 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : init spring 2024-06-04 10:51:00.006 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-06-04 10:51:00.006 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : starting 2024-06-04 10:51:00.028 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-06-04 10:51:00.033 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-06-04 10:51:00.033 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-06-04 10:51:00.033 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-06-04 10:51:00.033 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.2.2 2024-06-04 10:51:00.033 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.2.2 2024-06-04 10:51:00.039 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-06-04 10:51:00.305 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:00.351 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-06-04 10:51:00.681 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:51:00.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:51:00.749 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:00.749 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 443, createErrorCount 77 2024-06-04 10:51:00.750 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:51:00.757 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.75101128S 2024-06-04 10:51:00.757 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-06-04 10:51:00.810 INFO 77632 --- [pool-ocp-schedules-11,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-06-04 10:51:00.937 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:00.939 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:00.939 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 633, createErrorCount 77 2024-06-04 10:51:00.940 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 633, createErrorCount 77 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:00.943 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 637, createErrorCount 77 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 637, createErrorCount 77 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:00.943 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:00.953 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 647, createErrorCount 77 2024-06-04 10:51:01.009 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.026 INFO 77632 --- [pool-ocp-async-4,e2dcd8eac9224ae1,7cd5527591bf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:01.026 WARN 77632 --- [pool-ocp-async-6,aecde981e7a54a26,71e4d8242f90] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.026 WARN 77632 --- [pool-ocp-async-2,1f1b3bf9027a4fce,c7392a6d9dcd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:01.026 ERROR 77632 --- [pool-ocp-async-2,1f1b3bf9027a4fce,c7392a6d9dcd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 720, createErrorCount 77 2024-06-04 10:51:01.026 WARN 77632 --- [pool-ocp-async-10,a292d1a4d2664eea,9cd09868b187] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:01.026 ERROR 77632 --- [pool-ocp-async-10,a292d1a4d2664eea,9cd09868b187] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 720, createErrorCount 77 2024-06-04 10:51:01.027 WARN 77632 --- [pool-ocp-async-3,4db194593d0347d5,2b48ce740c43] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.027 WARN 77632 --- [pool-ocp-async-7,5ee3cd2ec52e4bce,12d8d611171c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:01.027 ERROR 77632 --- [pool-ocp-async-7,5ee3cd2ec52e4bce,12d8d611171c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 721, createErrorCount 77 2024-06-04 10:51:01.059 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.108 INFO 77632 --- [pool-metric-parse-4,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469460, message=java.net.ConnectException: connection timed out: /192.168.5.252:62889, rootCause=ConnectTimeoutException: connection timed out: /192.168.5.252:62889 2024-06-04 10:51:01.168 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.307 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.480 WARN 77632 --- [pool-ocp-schedules-13,36f60e507a8349d9,2024a4926328] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.773 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.818 WARN 77632 --- [pool-ocp-schedules-18,02ee5eba725e4adf,ab564f574b05] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:01.925 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:01.925 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1619, createErrorCount 77 2024-06-04 10:51:01.925 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1619, createErrorCount 77 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:01.953 WARN 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:01.953 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1647, createErrorCount 77 2024-06-04 10:51:01.953 ERROR 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1647, createErrorCount 77 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:01.954 INFO 77632 --- [pool-prometheus-minute-schedule-1,f0f6c31dbb2c4de7,d0441fe42124] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469457953, count=0, elapsed=4001 2024-06-04 10:51:01.954 INFO 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:02.000 WARN 77632 --- [pool-ocp-schedules-7,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:02.306 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 2000, createErrorCount 77 2024-06-04 10:51:02.307 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:02.309 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:02.694 INFO 77632 --- [pool-ocp-async-10,44c63b82aea04bdd,a863bc6c0264] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:51:02.704 WARN 77632 --- [pool-scanner-12506-1,44c63b82aea04bdd,d305dc67473f] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:51:02.877 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:02.877 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:02.881 INFO 77632 --- [pool-ocp-schedules-11,,] c.o.o.b.spring.BootstrapRunListener : failed 2024-06-04 10:51:02.888 INFO 77632 --- [pool-ocp-async-5,9c4adcc21132437e,6001475d23be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:51:02.937 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:02.937 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:02.937 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:02.953 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:02.989 WARN 77632 --- [pool-ocp-schedules-11,,] c.o.o.s.c.analyzer.OcpFailureAnalyzer : OCP startup check failed with cause: org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:771) at org.springframework.cloud.config.server.environment.JdbcEnvironmentRepository.addPropertySource(JdbcEnvironmentRepository.java:141) at org.springframework.cloud.config.server.environment.JdbcEnvironmentRepository.findOne(JdbcEnvironmentRepository.java:124) at org.springframework.cloud.config.server.environment.EnvironmentRepository.findOne(EnvironmentRepository.java:30) at org.springframework.cloud.config.server.environment.CompositeEnvironmentRepository.findOne(CompositeEnvironmentRepository.java:73) at org.springframework.cloud.config.server.environment.EnvironmentRepositoryPropertySourceLocator.locate(EnvironmentRepositoryPropertySourceLocator.java:53) at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:51) at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:47) at org.springframework.cloud.bootstrap.config.PropertySourceBootstrapConfiguration.initialize(PropertySourceBootstrapConfiguration.java:95) at org.springframework.boot.SpringApplication.applyInitializers(SpringApplication.java:604) at org.springframework.boot.SpringApplication.prepareContext(SpringApplication.java:373) at org.springframework.boot.SpringApplication.run(SpringApplication.java:306) at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:164) at org.springframework.cloud.context.refresh.LegacyContextRefresher.addConfigFilesToEnvironment(LegacyContextRefresher.java:78) at org.springframework.cloud.context.refresh.LegacyContextRefresher.updateEnvironment(LegacyContextRefresher.java:56) at org.springframework.cloud.context.refresh.ContextRefresher.refreshEnvironment(ContextRefresher.java:101) at org.springframework.cloud.context.refresh.ContextRefresher.refresh(ContextRefresher.java:94) at org.springframework.cloud.endpoint.RefreshEndpoint.refresh(RefreshEndpoint.java:41) at com.oceanbase.ocp.core.property.PropertyService.refresh(PropertyService.java:202) at com.oceanbase.ocp.service.task.scheduled.OcpSchedules.refreshConfig(OcpSchedules.java:87) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 37 common frames omitted Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 49 common frames omitted 2024-06-04 10:51:02.993 ERROR 77632 --- [pool-ocp-schedules-11,,] o.s.b.d.LoggingFailureAnalysisReporter : *************************** APPLICATION FAILED TO START *************************** Description: OCP application startup check failed. Action: Please check the stack trace above for the root cause. 2024-06-04 10:51:02.993 ERROR 77632 --- [pool-ocp-schedules-11,,] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:771) at org.springframework.cloud.config.server.environment.JdbcEnvironmentRepository.addPropertySource(JdbcEnvironmentRepository.java:141) at org.springframework.cloud.config.server.environment.JdbcEnvironmentRepository.findOne(JdbcEnvironmentRepository.java:124) at org.springframework.cloud.config.server.environment.EnvironmentRepository.findOne(EnvironmentRepository.java:30) at org.springframework.cloud.config.server.environment.CompositeEnvironmentRepository.findOne(CompositeEnvironmentRepository.java:73) at org.springframework.cloud.config.server.environment.EnvironmentRepositoryPropertySourceLocator.locate(EnvironmentRepositoryPropertySourceLocator.java:53) at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:51) at org.springframework.cloud.bootstrap.config.PropertySourceLocator.locateCollection(PropertySourceLocator.java:47) at org.springframework.cloud.bootstrap.config.PropertySourceBootstrapConfiguration.initialize(PropertySourceBootstrapConfiguration.java:95) at org.springframework.boot.SpringApplication.applyInitializers(SpringApplication.java:604) at org.springframework.boot.SpringApplication.prepareContext(SpringApplication.java:373) at org.springframework.boot.SpringApplication.run(SpringApplication.java:306) at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:164) at org.springframework.cloud.context.refresh.LegacyContextRefresher.addConfigFilesToEnvironment(LegacyContextRefresher.java:78) at org.springframework.cloud.context.refresh.LegacyContextRefresher.updateEnvironment(LegacyContextRefresher.java:56) at org.springframework.cloud.context.refresh.ContextRefresher.refreshEnvironment(ContextRefresher.java:101) at org.springframework.cloud.context.refresh.ContextRefresher.refresh(ContextRefresher.java:94) at org.springframework.cloud.endpoint.RefreshEndpoint.refresh(RefreshEndpoint.java:41) at com.oceanbase.ocp.core.property.PropertyService.refresh(PropertyService.java:202) at com.oceanbase.ocp.service.task.scheduled.OcpSchedules.refreshConfig(OcpSchedules.java:87) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 37 common frames omitted Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 49 common frames omitted 2024-06-04 10:51:03.009 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.010 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.010 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:03.013 WARN 77632 --- [pool-ocp-schedules-10,e292ffff07b342ee,3ca62e1255b9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.026 WARN 77632 --- [pool-ocp-async-6,aecde981e7a54a26,71e4d8242f90] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.026 ERROR 77632 --- [pool-ocp-async-6,aecde981e7a54a26,71e4d8242f90] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.026 WARN 77632 --- [pool-ocp-async-2,8d54ac693b154a38,28a4deb7bf6e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.026 WARN 77632 --- [pool-ocp-async-4,e2dcd8eac9224ae1,7cd5527591bf] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.027 INFO 77632 --- [pool-ocp-async-8,56f7f61126314c42,ec3896d5f0cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:03.027 WARN 77632 --- [pool-ocp-async-3,4db194593d0347d5,2b48ce740c43] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.027 ERROR 77632 --- [pool-ocp-async-3,4db194593d0347d5,2b48ce740c43] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.027 WARN 77632 --- [pool-ocp-async-7,6fd1f3ce947e4832,709a018e5179] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.037 WARN 77632 --- [pool-ocp-async-8,56f7f61126314c42,ec3896d5f0cd] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:03.059 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.059 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.060 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyHostAlarmTarget(ObproxyAlarmTargetProvider.java:84) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:03.161 WARN 77632 --- [pool-ocp-schedules-12,812735e81f0d48f6,e4484a610df2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.168 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.168 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.168 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:03.307 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.307 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 2024-06-04 10:51:03.307 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:03.480 WARN 77632 --- [pool-ocp-schedules-13,36f60e507a8349d9,2024a4926328] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.480 ERROR 77632 --- [pool-ocp-schedules-13,36f60e507a8349d9,2024a4926328] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 102, createErrorCount 79 2024-06-04 10:51:03.480 ERROR 77632 --- [pool-ocp-schedules-13,36f60e507a8349d9,2024a4926328] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 102, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:03.773 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.773 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 395, createErrorCount 79 2024-06-04 10:51:03.773 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 395, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:03.818 WARN 77632 --- [pool-ocp-schedules-18,02ee5eba725e4adf,ab564f574b05] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:03.818 ERROR 77632 --- [pool-ocp-schedules-18,02ee5eba725e4adf,ab564f574b05] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 440, createErrorCount 79 2024-06-04 10:51:03.818 ERROR 77632 --- [pool-ocp-schedules-18,02ee5eba725e4adf,ab564f574b05] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 440, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:03.943 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:03.954 WARN 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.000 ERROR 77632 --- [pool-ocp-schedules-7,,] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 622, createErrorCount 79 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:968) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1023) at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1033) at com.oceanbase.ocp.server.common.config.SpringSessionConfiguration$CustomizedJdbcIndexedSessionRepository.cleanUpExpiredSessions(SpringSessionConfiguration.java:115) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 622, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 14 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:04.695 WARN 77632 --- [alarm-detect-2,44c63b82aea04bdd,dbdeed87bef4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.695 WARN 77632 --- [alarm-detect-13,44c63b82aea04bdd,7cad178b4978] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.708 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.711 WARN 77632 --- [pool-ocp-schedules-17,f5d80cbce7fd4664,6319042f1eb4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.861 WARN 77632 --- [pool-overview-container-1,5857a6fc833849d8,aeaa1551fdb6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.861 WARN 77632 --- [pool-overview-container-3,016daeeaad4e4c88,db56274892d0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.861 WARN 77632 --- [pool-overview-container-8,58d4f0bf22aa45cf,ea1816f1e893] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.862 WARN 77632 --- [pool-overview-container-5,645f3e9916c248f1,1d39f1b79780] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.888 WARN 77632 --- [pool-ocp-async-5,9c4adcc21132437e,6001475d23be] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.888 WARN 77632 --- [pool-overview-container-2,e46c60f25d004570,d42fb6e762d6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.896 WARN 77632 --- [pool-overview-container-7,b86d9c9755e74189,b0b1d33d8feb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.917 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:04.954 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1576, createErrorCount 79 2024-06-04 10:51:05.013 WARN 77632 --- [pool-ocp-schedules-10,e292ffff07b342ee,3ca62e1255b9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.013 ERROR 77632 --- [pool-ocp-schedules-10,e292ffff07b342ee,3ca62e1255b9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1635, createErrorCount 79 2024-06-04 10:51:05.014 ERROR 77632 --- [pool-ocp-schedules-10,e292ffff07b342ee,3ca62e1255b9] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.AlarmSummaryServiceImpl.refreshClusterAlarmSummary(AlarmSummaryServiceImpl.java:94) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmSummary(AlarmSchedules.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1635, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.027 WARN 77632 --- [pool-ocp-async-2,8d54ac693b154a38,28a4deb7bf6e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.027 ERROR 77632 --- [pool-ocp-async-2,8d54ac693b154a38,28a4deb7bf6e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1649, createErrorCount 79 2024-06-04 10:51:05.027 WARN 77632 --- [pool-ocp-async-4,e2dcd8eac9224ae1,7cd5527591bf] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.027 ERROR 77632 --- [pool-ocp-async-4,e2dcd8eac9224ae1,7cd5527591bf] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1649, createErrorCount 79 2024-06-04 10:51:05.027 INFO 77632 --- [pool-ocp-async-2,973e0e168909497c,d67c2e9de036] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:05.028 WARN 77632 --- [pool-ocp-async-3,e5bcbb40c00d4b54,ffed79e0a85c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.028 WARN 77632 --- [pool-ocp-async-9,bec9c0956dc04369,bf56a02d92e5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.028 WARN 77632 --- [pool-ocp-async-7,6fd1f3ce947e4832,709a018e5179] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.028 ERROR 77632 --- [pool-ocp-async-7,6fd1f3ce947e4832,709a018e5179] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1650, createErrorCount 79 2024-06-04 10:51:05.061 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.161 WARN 77632 --- [pool-ocp-schedules-12,812735e81f0d48f6,e4484a610df2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.161 ERROR 77632 --- [pool-ocp-schedules-12,812735e81f0d48f6,e4484a610df2] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 79 2024-06-04 10:51:05.162 ERROR 77632 --- [pool-ocp-schedules-12,812735e81f0d48f6,e4484a610df2] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostVersionSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostVersionSchedule(ClusterSchedules.java:131) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 17 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1783, createErrorCount 79 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.380 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.381 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.612 WARN 77632 --- [pool-ocp-schedules-9,d8a839d475a04337,54ea369cfea5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.729 WARN 77632 --- [pool-ocp-async-10,44c63b82aea04bdd,a863bc6c0264] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:51:05.729 WARN 77632 --- [alarm-detect-2,44c63b82aea04bdd,dbdeed87bef4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.729 ERROR 77632 --- [alarm-detect-2,44c63b82aea04bdd,dbdeed87bef4] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:05.730 ERROR 77632 --- [alarm-detect-2,44c63b82aea04bdd,dbdeed87bef4] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_log_disk_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:05.730 WARN 77632 --- [alarm-detect-13,44c63b82aea04bdd,7cad178b4978] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.730 ERROR 77632 --- [alarm-detect-13,44c63b82aea04bdd,7cad178b4978] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:05.730 ERROR 77632 --- [alarm-detect-13,44c63b82aea04bdd,7cad178b4978] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_hwm org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:05.938 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.940 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.943 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.943 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 62, createErrorCount 80 2024-06-04 10:51:05.944 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 62, createErrorCount 80 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.946 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:05.949 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.949 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.954 WARN 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:05.954 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 81 2024-06-04 10:51:05.955 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:05.955 INFO 77632 --- [pool-prometheus-minute-schedule-1,7aa9c7e824d946bf,d6c074853a2c] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469461954, count=0, elapsed=4001 2024-06-04 10:51:05.955 INFO 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:06.010 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.169 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.282 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.317 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.332 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.692 WARN 77632 --- [pool-ocp-schedules-11,2a826d12ee1f496d,1948c425ff02] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.698 WARN 77632 --- [pool-ocp-schedules-15,0a1254accca1457e,36e2a1e7b55f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.708 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.708 ERROR 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 259, createErrorCount 81 2024-06-04 10:51:06.709 ERROR 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy339.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterSnapshots(RecordingRuleLabelMatchContainer.java:219) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:75) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 259, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.711 WARN 77632 --- [pool-ocp-schedules-17,f5d80cbce7fd4664,6319042f1eb4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.711 ERROR 77632 --- [pool-ocp-schedules-17,f5d80cbce7fd4664,6319042f1eb4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 262, createErrorCount 81 2024-06-04 10:51:06.712 ERROR 77632 --- [pool-ocp-schedules-17,f5d80cbce7fd4664,6319042f1eb4] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 262, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.774 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.846 WARN 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.862 WARN 77632 --- [pool-overview-container-3,016daeeaad4e4c88,db56274892d0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.862 ERROR 77632 --- [pool-overview-container-3,016daeeaad4e4c88,db56274892d0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 2024-06-04 10:51:06.862 WARN 77632 --- [pool-overview-container-8,58d4f0bf22aa45cf,ea1816f1e893] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.862 ERROR 77632 --- [pool-overview-container-8,58d4f0bf22aa45cf,ea1816f1e893] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 2024-06-04 10:51:06.862 ERROR 77632 --- [pool-overview-container-3,016daeeaad4e4c88,db56274892d0] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.862 ERROR 77632 --- [pool-overview-container-8,58d4f0bf22aa45cf,ea1816f1e893] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.862 WARN 77632 --- [pool-overview-container-3,016daeeaad4e4c88,db56274892d0] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.862 WARN 77632 --- [pool-overview-container-8,58d4f0bf22aa45cf,ea1816f1e893] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 412, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.865 WARN 77632 --- [pool-overview-container-1,5857a6fc833849d8,aeaa1551fdb6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.865 ERROR 77632 --- [pool-overview-container-1,5857a6fc833849d8,aeaa1551fdb6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 2024-06-04 10:51:06.866 ERROR 77632 --- [pool-overview-container-1,5857a6fc833849d8,aeaa1551fdb6] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.866 WARN 77632 --- [pool-overview-container-1,5857a6fc833849d8,aeaa1551fdb6] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2003, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.866 WARN 77632 --- [pool-overview-container-5,645f3e9916c248f1,1d39f1b79780] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.866 ERROR 77632 --- [pool-overview-container-5,645f3e9916c248f1,1d39f1b79780] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 2024-06-04 10:51:06.866 ERROR 77632 --- [pool-overview-container-5,645f3e9916c248f1,1d39f1b79780] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.867 WARN 77632 --- [pool-overview-container-5,645f3e9916c248f1,1d39f1b79780] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2004, active 0, maxActive 200, creating 1, createElapseMillis 416, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.888 WARN 77632 --- [pool-ocp-async-5,9c4adcc21132437e,6001475d23be] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.889 ERROR 77632 --- [pool-ocp-async-5,9c4adcc21132437e,6001475d23be] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 439, createErrorCount 81 2024-06-04 10:51:06.889 WARN 77632 --- [pool-overview-container-2,e46c60f25d004570,d42fb6e762d6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.889 ERROR 77632 --- [pool-overview-container-2,e46c60f25d004570,d42fb6e762d6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 439, createErrorCount 81 2024-06-04 10:51:06.889 ERROR 77632 --- [pool-overview-container-2,e46c60f25d004570,d42fb6e762d6] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 439, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.889 WARN 77632 --- [pool-overview-container-2,e46c60f25d004570,d42fb6e762d6] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 439, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.891 WARN 77632 --- [pool-ocp-schedules-2,b98caa8df7fa4712,94609c71ecbc] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.896 WARN 77632 --- [pool-overview-container-7,b86d9c9755e74189,b0b1d33d8feb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.896 ERROR 77632 --- [pool-overview-container-7,b86d9c9755e74189,b0b1d33d8feb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 446, createErrorCount 81 2024-06-04 10:51:06.896 ERROR 77632 --- [pool-overview-container-7,b86d9c9755e74189,b0b1d33d8feb] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 446, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.897 WARN 77632 --- [pool-overview-container-7,b86d9c9755e74189,b0b1d33d8feb] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 446, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.917 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:06.918 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 468, createErrorCount 81 2024-06-04 10:51:06.918 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 468, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:06.926 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:06.954 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:07.027 INFO 77632 --- [pool-ocp-async-5,91f621c2fcde4741,c0b464943cd4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:07.027 WARN 77632 --- [pool-ocp-async-8,8bb23910867e4ad4,3085470c9b90] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:07.027 WARN 77632 --- [pool-ocp-async-2,973e0e168909497c,d67c2e9de036] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:07.027 WARN 77632 --- [pool-ocp-async-6,64d611b056c84db2,c9d6762efa5d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:07.028 WARN 77632 --- [pool-ocp-async-3,e5bcbb40c00d4b54,ffed79e0a85c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.028 ERROR 77632 --- [pool-ocp-async-3,e5bcbb40c00d4b54,ffed79e0a85c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 578, createErrorCount 81 2024-06-04 10:51:07.028 WARN 77632 --- [pool-ocp-async-9,bec9c0956dc04369,bf56a02d92e5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.028 ERROR 77632 --- [pool-ocp-async-9,bec9c0956dc04369,bf56a02d92e5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 578, createErrorCount 81 2024-06-04 10:51:07.037 WARN 77632 --- [pool-ocp-async-5,91f621c2fcde4741,c0b464943cd4] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:07.061 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.061 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 611, createErrorCount 81 2024-06-04 10:51:07.061 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findByNameOrConnectableObclusterName(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClustersWithAuthorization(ObproxyServiceImpl.java:725) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:180) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listObproxyClusters(ObproxyServiceImpl.java:190) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listObproxyClusters() at com.oceanbase.ocp.service.obproxy.ObproxyAlarmTargetProvider.buildObproxyLogAlarmTarget(ObproxyAlarmTargetProvider.java:90) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 33 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 611, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 75 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:07.612 WARN 77632 --- [pool-ocp-schedules-9,d8a839d475a04337,54ea369cfea5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.612 ERROR 77632 --- [pool-ocp-schedules-9,d8a839d475a04337,54ea369cfea5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1163, createErrorCount 81 2024-06-04 10:51:07.613 ERROR 77632 --- [pool-ocp-schedules-9,d8a839d475a04337,54ea369cfea5] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.resolveAlarms(OcpAlarmSearchService.java:531) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.resolveAlarmsOfAbsentTargets(AlarmSchedules.java:94) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 34 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1163, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 76 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:07.750 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:07.938 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.938 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1488, createErrorCount 81 2024-06-04 10:51:07.938 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:07.940 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:07.940 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1491, createErrorCount 81 2024-06-04 10:51:07.941 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1491, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:07.946 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1496, createErrorCount 81 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1496, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:07.946 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:07.955 WARN 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:08.011 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.011 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1561, createErrorCount 81 2024-06-04 10:51:08.011 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:08.169 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.169 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1720, createErrorCount 81 2024-06-04 10:51:08.169 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:08.282 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.282 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1832, createErrorCount 81 2024-06-04 10:51:08.282 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:51:08.317 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.317 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1867, createErrorCount 81 2024-06-04 10:51:08.317 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1867, createErrorCount 81 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.332 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.332 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1883, createErrorCount 81 2024-06-04 10:51:08.332 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:51:08.451 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.451 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.692 WARN 77632 --- [pool-ocp-schedules-11,2a826d12ee1f496d,1948c425ff02] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.692 ERROR 77632 --- [pool-ocp-schedules-11,2a826d12ee1f496d,1948c425ff02] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 2024-06-04 10:51:08.693 ERROR 77632 --- [pool-ocp-schedules-11,2a826d12ee1f496d,1948c425ff02] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.core.notification.NotificationSender.refresh(NotificationSender.java:114) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmInMemtory(AlarmSchedules.java:134) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 34 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.698 WARN 77632 --- [pool-ocp-schedules-15,0a1254accca1457e,36e2a1e7b55f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.698 ERROR 77632 --- [pool-ocp-schedules-15,0a1254accca1457e,36e2a1e7b55f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 2024-06-04 10:51:08.698 ERROR 77632 --- [pool-ocp-schedules-15,0a1254accca1457e,36e2a1e7b55f] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.refreshActiveAlarmStatus(OcpAlarmSearchService.java:508) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshActiveAlarmStatus(AlarmSchedules.java:89) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 25 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 67 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.709 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:08.774 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.774 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 2024-06-04 10:51:08.774 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 82 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.847 INFO 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] c.o.o.a.s.AlarmInMemoryServiceImpl : create alarm ocp_meta_db_disconnected class OcpLabels { {svr_ip=192.168.5.253, db=metadb} } 2024-06-04 10:51:08.929 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:08.929 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 0, createErrorCount 82 2024-06-04 10:51:08.930 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2002, active 0, maxActive 200, creating 0, createErrorCount 82 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:08.954 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 2, createErrorCount 82 2024-06-04 10:51:09.023 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:09.023 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:09.027 INFO 77632 --- [pool-ocp-async-9,82628a4bbaa84318,047d7abdf3b5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:09.028 WARN 77632 --- [pool-ocp-async-4,6cb2a3af6230434d,780515ef57d1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:09.028 WARN 77632 --- [pool-ocp-async-10,464570444fdd4fa9,b22b23b22e61] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:09.028 WARN 77632 --- [pool-ocp-async-8,8bb23910867e4ad4,3085470c9b90] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:09.028 ERROR 77632 --- [pool-ocp-async-8,8bb23910867e4ad4,3085470c9b90] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 83 2024-06-04 10:51:09.028 WARN 77632 --- [pool-ocp-async-6,64d611b056c84db2,c9d6762efa5d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:09.028 ERROR 77632 --- [pool-ocp-async-6,64d611b056c84db2,c9d6762efa5d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 83 2024-06-04 10:51:09.028 WARN 77632 --- [pool-ocp-async-2,973e0e168909497c,d67c2e9de036] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:09.028 ERROR 77632 --- [pool-ocp-async-2,973e0e168909497c,d67c2e9de036] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 83 2024-06-04 10:51:09.062 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:09.750 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:09.750 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 226, createErrorCount 83 2024-06-04 10:51:09.750 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:51:09.955 WARN 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:09.955 ERROR 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 431, createErrorCount 83 2024-06-04 10:51:09.956 ERROR 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 431, createErrorCount 83 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:09.956 INFO 77632 --- [pool-prometheus-minute-schedule-1,1c8b06bb2cea4933,5dfd12c43820] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469465955, count=0, elapsed=4001 2024-06-04 10:51:09.956 INFO 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:10.709 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:10.709 ERROR 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1185, createErrorCount 83 2024-06-04 10:51:10.710 ERROR 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.o.m.h.RecordingRuleLabelMatchContainer : refreshClusterTenantSnapshots error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy364.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshClusterTenantSnapshots(RecordingRuleLabelMatchContainer.java:248) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:76) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1185, createErrorCount 83 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:10.847 WARN 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:10.938 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:10.948 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:10.954 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.018 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.028 INFO 77632 --- [pool-ocp-async-6,45e536526f584fe9,1a5ae0a60fe4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:11.028 WARN 77632 --- [pool-ocp-async-10,464570444fdd4fa9,b22b23b22e61] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:11.028 ERROR 77632 --- [pool-ocp-async-10,464570444fdd4fa9,b22b23b22e61] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1504, createErrorCount 83 2024-06-04 10:51:11.029 WARN 77632 --- [pool-ocp-async-7,20f1461cba3d450b,4ec69508231b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.029 WARN 77632 --- [pool-ocp-async-3,25b56ad2dd5b47b4,12684fd5f77a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.029 WARN 77632 --- [pool-ocp-async-9,82628a4bbaa84318,047d7abdf3b5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.029 WARN 77632 --- [pool-ocp-async-4,6cb2a3af6230434d,780515ef57d1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:11.029 ERROR 77632 --- [pool-ocp-async-4,6cb2a3af6230434d,780515ef57d1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1505, createErrorCount 83 2024-06-04 10:51:11.038 WARN 77632 --- [pool-ocp-async-6,45e536526f584fe9,1a5ae0a60fe4] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:11.062 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:11.062 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1538, createErrorCount 83 2024-06-04 10:51:11.063 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:334) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildOcpHostAlarmTarget(OcpHostAlarmTargetProvider.java:69) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 42 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1538, createErrorCount 83 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 46 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:11.170 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.250 WARN 77632 --- [pool-ocp-schedules-10,44653ee9c2494e13,0a5000d88002] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.318 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.526 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:11.526 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:11.575 INFO 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /services?Action=ObRootServiceInfo&User_ID=alibaba&UID=ocpmaster&ObRegion=Ren_Test&version=2&ObClusterId=1717467632, client=0:0:0:0:0:0:0:1, traceId=c6c8482d701b4817, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(String,Long,String,Long,Integer,String), args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469469572067,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},] 2024-06-04 10:51:11.775 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.919 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:11.956 WARN 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:12.094 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:12.094 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:12.694 INFO 77632 --- [pool-ocp-async-2,c8f4f883613b4124,40030bdad927] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:51:12.710 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:12.712 WARN 77632 --- [pool-scanner-12530-1,c8f4f883613b4124,f693453988c6] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:51:12.847 WARN 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:12.847 ERROR 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 253, createErrorCount 85 2024-06-04 10:51:12.848 ERROR 77632 --- [pool-ocp-schedules-8,5083380a592c4925,571d9e83d5d7] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy391.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService.listAll(OcpAlarmGroupService.java:209) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService$$FastClassBySpringCGLIB$$44910b7f.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmGroupService$$EnhancerBySpringCGLIB$$38a863ae.listAll() at com.oceanbase.ocp.alarm.service.AlarmInMemoryServiceImpl.createAlarm(AlarmInMemoryServiceImpl.java:96) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.createMetaDBAlarmInMemory(HealthCheckService.java:148) at com.oceanbase.ocp.service.healthcheck.HealthCheckService.checkMetaDbHealth(HealthCheckService.java:126) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 38 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 253, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 42 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:12.888 INFO 77632 --- [pool-ocp-async-6,c080b13cb8df487b,719582165722] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:51:12.938 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:12.938 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 344, createErrorCount 85 2024-06-04 10:51:12.938 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:12.941 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:12.946 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:12.948 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:12.949 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 354, createErrorCount 85 2024-06-04 10:51:12.949 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 354, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:12.954 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 360, createErrorCount 85 2024-06-04 10:51:13.018 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.018 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 424, createErrorCount 85 2024-06-04 10:51:13.018 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:13.028 WARN 77632 --- [pool-ocp-async-8,4c9c7538a9244835,511bc1815a8b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.028 WARN 77632 --- [pool-ocp-async-5,948b176891b44cf6,57de5b1d9508] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.029 WARN 77632 --- [pool-ocp-async-7,20f1461cba3d450b,4ec69508231b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.029 ERROR 77632 --- [pool-ocp-async-7,20f1461cba3d450b,4ec69508231b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 435, createErrorCount 85 2024-06-04 10:51:13.029 WARN 77632 --- [pool-ocp-async-9,82628a4bbaa84318,047d7abdf3b5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.029 ERROR 77632 --- [pool-ocp-async-9,82628a4bbaa84318,047d7abdf3b5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 435, createErrorCount 85 2024-06-04 10:51:13.029 INFO 77632 --- [pool-ocp-async-7,f0c38167cf5e4420,2841e010ff7f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:13.029 WARN 77632 --- [pool-ocp-async-3,25b56ad2dd5b47b4,12684fd5f77a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.029 ERROR 77632 --- [pool-ocp-async-3,25b56ad2dd5b47b4,12684fd5f77a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 435, createErrorCount 85 2024-06-04 10:51:13.063 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.170 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.170 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 576, createErrorCount 85 2024-06-04 10:51:13.170 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:13.251 WARN 77632 --- [pool-ocp-schedules-10,44653ee9c2494e13,0a5000d88002] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.251 ERROR 77632 --- [pool-ocp-schedules-10,44653ee9c2494e13,0a5000d88002] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 656, createErrorCount 85 2024-06-04 10:51:13.251 ERROR 77632 --- [pool-ocp-schedules-10,44653ee9c2494e13,0a5000d88002] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at collect-obproxy-metrics at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.lockAndExec(ObproxySchedules.java:34) at com.oceanbase.ocp.obproxyops.internal.task.ObproxySchedules.collectObproxyMetrics(ObproxySchedules.java:29) at sun.reflect.GeneratedMethodAccessor502.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 656, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:13.318 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.318 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 724, createErrorCount 85 2024-06-04 10:51:13.318 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 724, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:13.577 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.775 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.775 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1180, createErrorCount 85 2024-06-04 10:51:13.775 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1180, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:13.819 INFO 77632 --- [pool-ocp-schedules-2,1fca037a618c4f6b,92df05f5f148] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:51:13.916 WARN 77632 --- [pool-prometheus-exporter-check1,ab035830b47b4da1,d8fea33be394] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.919 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.919 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1324, createErrorCount 85 2024-06-04 10:51:13.919 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1324, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:13.930 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:13.956 WARN 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:13.957 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1362, createErrorCount 85 2024-06-04 10:51:13.957 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1362, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:13.957 INFO 77632 --- [pool-prometheus-minute-schedule-1,4cd17dbfdbf54a89,486aa94ddefd] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469469956, count=0, elapsed=4001 2024-06-04 10:51:13.957 INFO 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:14.096 ERROR 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:51:14.096 WARN 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : no ready nodes for cache. startTime = 1717469340 2024-06-04 10:51:14.096 INFO 77632 --- [pool-async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-06-04 10:51:14.096 ERROR 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Find allocated recording rules failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:746) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:802) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:209) at org.springframework.jdbc.core.namedparam.NamedParameterJdbcTemplate.query(NamedParameterJdbcTemplate.java:221) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo.findAll(AsyncComputeRecordingRuleRepo.java:25) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$FastClassBySpringCGLIB$$ffd2cf72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.repository.AsyncComputeRecordingRuleRepo$$EnhancerBySpringCGLIB$$a4252a49.findAll() at com.oceanbase.ocp.monitor.service.AsyncComputeRecordingRuleServiceImpl.fetchAllGroupedRecordingRules(AsyncComputeRecordingRuleServiceImpl.java:27) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllRecordingRules(ShardingRecordingRulesHelper.java:74) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:65) at com.oceanbase.ocp.monitor.service.ShardingRecordingRulesHelper.findAllocatedRecordingRules(ShardingRecordingRulesHelper.java:53) at com.oceanbase.ocp.monitor.asyncCompute.MonitorAsyncComputeProcessor.offerNodes(MonitorAsyncComputeProcessor.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriverManager(DriverManagerDataSource.java:155) at org.springframework.jdbc.datasource.DriverManagerDataSource.getConnectionFromDriver(DriverManagerDataSource.java:146) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnectionFromDriver(AbstractDriverBasedDataSource.java:205) at org.springframework.jdbc.datasource.AbstractDriverBasedDataSource.getConnection(AbstractDriverBasedDataSource.java:169) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 29 common frames omitted Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 41 common frames omitted 2024-06-04 10:51:14.096 WARN 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : no ready nodes for cache. startTime = 1717469385 2024-06-04 10:51:14.096 INFO 77632 --- [pool-async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-06-04 10:51:14.306 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.596 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:14.596 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:14.694 WARN 77632 --- [alarm-detect-11,c8f4f883613b4124,8cf5618b8481] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.694 WARN 77632 --- [alarm-detect-6,c8f4f883613b4124,cb3702b7f724] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-15,c8f4f883613b4124,191107973e88] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-8,c8f4f883613b4124,d45c9912be49] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-12,c8f4f883613b4124,1c6736159c9e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-29,c8f4f883613b4124,28da5d2aa9c8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-7,c8f4f883613b4124,3d8044564afd] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-20,c8f4f883613b4124,77fe050359f6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-22,c8f4f883613b4124,47eef8f2820c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-9,c8f4f883613b4124,0ce86e428001] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.695 WARN 77632 --- [alarm-detect-23,c8f4f883613b4124,6fbc82260fea] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.696 WARN 77632 --- [alarm-detect-14,c8f4f883613b4124,b1225d446087] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.696 WARN 77632 --- [alarm-detect-26,c8f4f883613b4124,fb4562d9fa3f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.696 WARN 77632 --- [alarm-detect-28,c8f4f883613b4124,b5cbdf8b9b33] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.696 WARN 77632 --- [alarm-detect-3,c8f4f883613b4124,eb9d707dabd5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.696 WARN 77632 --- [alarm-detect-21,c8f4f883613b4124,8938b228f479] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.709 WARN 77632 --- [alarm-detect-19,c8f4f883613b4124,08eebc7ae4e3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.710 WARN 77632 --- [alarm-detect-10,c8f4f883613b4124,e66da8b68f29] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.710 WARN 77632 --- [alarm-detect-30,c8f4f883613b4124,60cc4648c4e2] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.710 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:14.710 ERROR 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 2024-06-04 10:51:14.711 WARN 77632 --- [pool-ocp-async-1,b996650afcce4f39,1323bd335cde] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(), params=[] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshObProxySnapshots(RecordingRuleLabelMatchContainer.java:269) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer.refreshSnapshots(RecordingRuleLabelMatchContainer.java:77) at com.oceanbase.ocp.monitor.helper.RecordingRuleLabelMatchContainer$$FastClassBySpringCGLIB$$ef3af431.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:14.715 WARN 77632 --- [alarm-detect-18,c8f4f883613b4124,2dfd2f7f9991] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.716 WARN 77632 --- [alarm-detect-27,c8f4f883613b4124,ed0d103c648f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.862 WARN 77632 --- [pool-overview-container-4,6e9e7905b53b4a24,58c426cbd4a5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.862 WARN 77632 --- [pool-overview-container-8,8acb95dbb28046f4,ae973e7a2f81] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.862 WARN 77632 --- [pool-overview-container-6,25359cf276b64dde,7f6c4c92f945] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.862 WARN 77632 --- [pool-overview-container-3,b747a85de7b24377,326ec6f4d44f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.888 WARN 77632 --- [pool-ocp-async-6,c080b13cb8df487b,719582165722] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.888 WARN 77632 --- [pool-overview-container-5,d2f4412349574202,56c98e08be46] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.888 WARN 77632 --- [pool-overview-container-1,b5e4e4823482433a,8f19b76d4004] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:14.942 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:14.942 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 2024-06-04 10:51:14.942 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:14.947 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:14.947 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:14.955 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.028 INFO 77632 --- [pool-ocp-async-9,cc7abb9f853e42b5,0d0c3a763fae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:15.028 WARN 77632 --- [pool-ocp-async-10,7212866664a24a90,78f24b11a3b8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.028 WARN 77632 --- [pool-ocp-async-4,fd5a41fde0864bee,b9851a9eba99] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.028 WARN 77632 --- [pool-ocp-async-5,948b176891b44cf6,57de5b1d9508] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.028 WARN 77632 --- [pool-ocp-async-8,4c9c7538a9244835,511bc1815a8b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.028 ERROR 77632 --- [pool-ocp-async-5,948b176891b44cf6,57de5b1d9508] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 2024-06-04 10:51:15.028 ERROR 77632 --- [pool-ocp-async-8,4c9c7538a9244835,511bc1815a8b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 2024-06-04 10:51:15.029 WARN 77632 --- [pool-ocp-async-7,f0c38167cf5e4420,2841e010ff7f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.038 WARN 77632 --- [pool-ocp-async-9,cc7abb9f853e42b5,0d0c3a763fae] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:15.063 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.063 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 2024-06-04 10:51:15.064 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:334) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildHostLogAlarmTarget(OcpHostAlarmTargetProvider.java:75) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 42 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 86 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 46 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.165 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.165 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.167 INFO 77632 --- [pool-metric-parse-1,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469475, message=java.net.ConnectException: No route to host: /192.168.5.252:62889, rootCause=NoRouteToHostException: No route to host 2024-06-04 10:51:15.283 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.333 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.481 WARN 77632 --- [pool-ocp-schedules-9,2eb823dfe8b6443b,7d8cf28f1cdb] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.577 WARN 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.577 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 87 2024-06-04 10:51:15.578 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] c.o.o.s.c.trace.RequestTracingAspect : Unexpected API Error: [POST /services client=0:0:0:0:0:0:0:1, traceId=c6c8482d701b4817, args=Ren_Test,1717467632,2,{"ObRegion":"Ren_Test","ObCluster":"Ren_Test","ObRegionId":1717467632,"ObClusterId":1717467632,"Type":"PRIMARY","timestamp":1717469469572067,"RsList":[{"address":"192.168.5.253:2882","role":"LEADER","sql_port":2881},{"address":"192.168.5.254:2882","role":"FOLLOWER","sql_port":2881}],"ReadonlyRsList":[]},, duration=4004 ms] org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.579 ERROR 77632 --- [http-nio-0.0.0.0-8080-exec-9,c6c8482d701b4817,547cfca1b4f1] c.o.o.s.c.exception.RpcExceptionHandler : Unhandled exception, uri=/services, duration=4006 org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.configurl.ConfigUrlService$$EnhancerBySpringCGLIB$$be79cf46.updateRootServer() at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.updateRootServiceInfo(OcpControllerConfig.java:68) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$FastClassBySpringCGLIB$$5ac16e30.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:58) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at com.oceanbase.ocp.server.common.aspect.OperationEventAspect.aroundAuditEvent(OperationEventAspect.java:128) at sun.reflect.GeneratedMethodAccessor370.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig$$EnhancerBySpringCGLIB$$defc4f46.updateRootServiceInfo() at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909) at javax.servlet.http.HttpServlet.service(HttpServlet.java:528) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:596) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.servlet.resource.ResourceUrlEncodingFilter.doFilter(ResourceUrlEncodingFilter.java:67) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:337) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:115) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:122) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:116) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:126) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:81) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:109) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:149) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:223) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:217) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter.doFilterInternal(PreAuthenticationFilter.java:106) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:103) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:89) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.csrf.CsrfFilter.doFilterInternal(CsrfFilter.java:117) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.header.HeaderWriterFilter.doHeadersAfter(HeaderWriterFilter.java:90) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:75) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:112) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:82) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:55) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.session.DisableEncodeUrlFilter.doFilterInternal(DisableEncodeUrlFilter.java:42) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:346) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:221) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:186) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:354) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:267) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at com.oceanbase.ocp.server.common.trace.TraceFilter.doFilter(TraceFilter.java:47) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.session.web.http.SessionRepositoryFilter.doFilterInternal(SessionRepositoryFilter.java:141) at org.springframework.session.web.http.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:82) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:492) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 150 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 157 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.712 WARN 77632 --- [pool-ocp-async-2,c8f4f883613b4124,40030bdad927] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:51:15.713 WARN 77632 --- [alarm-detect-11,c8f4f883613b4124,8cf5618b8481] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.713 ERROR 77632 --- [alarm-detect-11,c8f4f883613b4124,8cf5618b8481] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.713 WARN 77632 --- [alarm-detect-29,c8f4f883613b4124,28da5d2aa9c8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.713 ERROR 77632 --- [alarm-detect-29,c8f4f883613b4124,28da5d2aa9c8] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.713 ERROR 77632 --- [alarm-detect-29,c8f4f883613b4124,28da5d2aa9c8] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obproxy_cannot_connected org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.713 ERROR 77632 --- [alarm-detect-11,c8f4f883613b4124,8cf5618b8481] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_cannot_connect_arbitration org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.713 WARN 77632 --- [alarm-detect-30,c8f4f883613b4124,60cc4648c4e2] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.713 ERROR 77632 --- [alarm-detect-30,c8f4f883613b4124,60cc4648c4e2] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.714 ERROR 77632 --- [alarm-detect-30,c8f4f883613b4124,60cc4648c4e2] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obdns_etcd_cannot_connect_to_leader org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.719 WARN 77632 --- [alarm-detect-10,c8f4f883613b4124,e66da8b68f29] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.719 ERROR 77632 --- [alarm-detect-10,c8f4f883613b4124,e66da8b68f29] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.719 ERROR 77632 --- [alarm-detect-10,c8f4f883613b4124,e66da8b68f29] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ic_server_connect_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.719 WARN 77632 --- [alarm-detect-18,c8f4f883613b4124,2dfd2f7f9991] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.719 ERROR 77632 --- [alarm-detect-18,c8f4f883613b4124,2dfd2f7f9991] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.720 WARN 77632 --- [alarm-detect-12,c8f4f883613b4124,1c6736159c9e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.720 ERROR 77632 --- [alarm-detect-12,c8f4f883613b4124,1c6736159c9e] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.720 ERROR 77632 --- [alarm-detect-18,c8f4f883613b4124,2dfd2f7f9991] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_process_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.720 ERROR 77632 --- [alarm-detect-12,c8f4f883613b4124,1c6736159c9e] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_recyclebin_disk_used_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.720 WARN 77632 --- [alarm-detect-14,c8f4f883613b4124,b1225d446087] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.720 ERROR 77632 --- [alarm-detect-14,c8f4f883613b4124,b1225d446087] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.721 ERROR 77632 --- [alarm-detect-14,c8f4f883613b4124,b1225d446087] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_error org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.721 WARN 77632 --- [alarm-detect-26,c8f4f883613b4124,fb4562d9fa3f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.721 ERROR 77632 --- [alarm-detect-26,c8f4f883613b4124,fb4562d9fa3f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.722 ERROR 77632 --- [alarm-detect-26,c8f4f883613b4124,fb4562d9fa3f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.722 WARN 77632 --- [alarm-detect-19,c8f4f883613b4124,08eebc7ae4e3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.722 ERROR 77632 --- [alarm-detect-19,c8f4f883613b4124,08eebc7ae4e3] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.722 WARN 77632 --- [alarm-detect-6,c8f4f883613b4124,cb3702b7f724] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.722 ERROR 77632 --- [alarm-detect-6,c8f4f883613b4124,cb3702b7f724] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.723 ERROR 77632 --- [alarm-detect-19,c8f4f883613b4124,08eebc7ae4e3] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_ip_forward_invalid org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.723 ERROR 77632 --- [alarm-detect-6,c8f4f883613b4124,cb3702b7f724] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_partition_leader_absent org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.723 WARN 77632 --- [alarm-detect-15,c8f4f883613b4124,191107973e88] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.723 ERROR 77632 --- [alarm-detect-15,c8f4f883613b4124,191107973e88] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.723 ERROR 77632 --- [alarm-detect-15,c8f4f883613b4124,191107973e88] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cpu_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.724 WARN 77632 --- [alarm-detect-8,c8f4f883613b4124,d45c9912be49] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.724 ERROR 77632 --- [alarm-detect-8,c8f4f883613b4124,d45c9912be49] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.724 ERROR 77632 --- [alarm-detect-8,c8f4f883613b4124,d45c9912be49] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=backup_storage_capacity_retry_times_exceeded org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.724 WARN 77632 --- [alarm-detect-7,c8f4f883613b4124,3d8044564afd] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.724 ERROR 77632 --- [alarm-detect-7,c8f4f883613b4124,3d8044564afd] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.725 ERROR 77632 --- [alarm-detect-7,c8f4f883613b4124,3d8044564afd] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_net_send_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.725 WARN 77632 --- [alarm-detect-20,c8f4f883613b4124,77fe050359f6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.725 ERROR 77632 --- [alarm-detect-20,c8f4f883613b4124,77fe050359f6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.725 ERROR 77632 --- [alarm-detect-20,c8f4f883613b4124,77fe050359f6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_sda_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.729 WARN 77632 --- [alarm-detect-22,c8f4f883613b4124,47eef8f2820c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.729 ERROR 77632 --- [alarm-detect-22,c8f4f883613b4124,47eef8f2820c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.729 WARN 77632 --- [alarm-detect-9,c8f4f883613b4124,0ce86e428001] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.729 ERROR 77632 --- [alarm-detect-9,c8f4f883613b4124,0ce86e428001] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.730 ERROR 77632 --- [alarm-detect-9,c8f4f883613b4124,0ce86e428001] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_nvme_ioawait org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.730 ERROR 77632 --- [alarm-detect-22,c8f4f883613b4124,47eef8f2820c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=refresh_location_cache_failed_by_metric org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.730 WARN 77632 --- [alarm-detect-23,c8f4f883613b4124,6fbc82260fea] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.730 ERROR 77632 --- [alarm-detect-23,c8f4f883613b4124,6fbc82260fea] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.730 ERROR 77632 --- [alarm-detect-23,c8f4f883613b4124,6fbc82260fea] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_sync_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.730 WARN 77632 --- [alarm-detect-27,c8f4f883613b4124,ed0d103c648f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.730 ERROR 77632 --- [alarm-detect-27,c8f4f883613b4124,ed0d103c648f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.731 ERROR 77632 --- [alarm-detect-27,c8f4f883613b4124,ed0d103c648f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=oblb_nic_usage_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.731 WARN 77632 --- [alarm-detect-28,c8f4f883613b4124,b5cbdf8b9b33] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.731 ERROR 77632 --- [alarm-detect-28,c8f4f883613b4124,b5cbdf8b9b33] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.731 ERROR 77632 --- [alarm-detect-28,c8f4f883613b4124,b5cbdf8b9b33] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=arbitration_service_unavailable org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.732 WARN 77632 --- [alarm-detect-3,c8f4f883613b4124,eb9d707dabd5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.732 ERROR 77632 --- [alarm-detect-3,c8f4f883613b4124,eb9d707dabd5] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.732 ERROR 77632 --- [alarm-detect-3,c8f4f883613b4124,eb9d707dabd5] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=tenant_active_memstore_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.732 WARN 77632 --- [alarm-detect-21,c8f4f883613b4124,8938b228f479] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.732 ERROR 77632 --- [alarm-detect-21,c8f4f883613b4124,8938b228f479] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:15.732 ERROR 77632 --- [alarm-detect-21,c8f4f883613b4124,8938b228f479] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=obagent_dead org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:15.819 WARN 77632 --- [pool-ocp-schedules-2,1fca037a618c4f6b,92df05f5f148] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.916 WARN 77632 --- [pool-prometheus-exporter-check1,ab035830b47b4da1,d8fea33be394] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,ab035830b47b4da1,d8fea33be394] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 248, createErrorCount 87 2024-06-04 10:51:15.916 ERROR 77632 --- [pool-prometheus-exporter-check1,ab035830b47b4da1,d8fea33be394] c.o.ocp.monitor.OcpMonitorManager : checkActiveExporters failed: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.getAllExporterIdsWithSwitchOn(OcpExporterServiceImpl.java:178) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkActive(OcpExporterStatusCheckServiceImpl.java:87) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$3(OcpMonitorManager.java:144) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 27 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 248, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.930 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:15.930 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 263, createErrorCount 87 2024-06-04 10:51:15.931 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 263, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:15.939 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:15.957 WARN 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.018 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.170 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.306 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 639, createErrorCount 87 2024-06-04 10:51:16.319 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.750 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.775 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:16.862 WARN 77632 --- [pool-overview-container-4,6e9e7905b53b4a24,58c426cbd4a5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.862 ERROR 77632 --- [pool-overview-container-4,6e9e7905b53b4a24,58c426cbd4a5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1194, createErrorCount 87 2024-06-04 10:51:16.862 WARN 77632 --- [pool-overview-container-8,8acb95dbb28046f4,ae973e7a2f81] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.862 ERROR 77632 --- [pool-overview-container-8,8acb95dbb28046f4,ae973e7a2f81] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1195, createErrorCount 87 2024-06-04 10:51:16.862 ERROR 77632 --- [pool-overview-container-8,8acb95dbb28046f4,ae973e7a2f81] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1195, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.863 ERROR 77632 --- [pool-overview-container-4,6e9e7905b53b4a24,58c426cbd4a5] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1194, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.863 WARN 77632 --- [pool-overview-container-8,8acb95dbb28046f4,ae973e7a2f81] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1195, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.863 WARN 77632 --- [pool-overview-container-4,6e9e7905b53b4a24,58c426cbd4a5] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1194, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.863 WARN 77632 --- [pool-overview-container-6,25359cf276b64dde,7f6c4c92f945] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.863 ERROR 77632 --- [pool-overview-container-6,25359cf276b64dde,7f6c4c92f945] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 2024-06-04 10:51:16.863 ERROR 77632 --- [pool-overview-container-6,25359cf276b64dde,7f6c4c92f945] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.863 WARN 77632 --- [pool-overview-container-6,25359cf276b64dde,7f6c4c92f945] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.864 WARN 77632 --- [pool-overview-container-3,b747a85de7b24377,326ec6f4d44f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.864 ERROR 77632 --- [pool-overview-container-3,b747a85de7b24377,326ec6f4d44f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 2024-06-04 10:51:16.864 ERROR 77632 --- [pool-overview-container-3,b747a85de7b24377,326ec6f4d44f] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.864 WARN 77632 --- [pool-overview-container-3,b747a85de7b24377,326ec6f4d44f] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1196, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.888 WARN 77632 --- [pool-ocp-async-6,c080b13cb8df487b,719582165722] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.889 ERROR 77632 --- [pool-ocp-async-6,c080b13cb8df487b,719582165722] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 2024-06-04 10:51:16.889 WARN 77632 --- [pool-overview-container-1,b5e4e4823482433a,8f19b76d4004] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.888 WARN 77632 --- [pool-overview-container-5,d2f4412349574202,56c98e08be46] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:16.889 ERROR 77632 --- [pool-overview-container-1,b5e4e4823482433a,8f19b76d4004] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 2024-06-04 10:51:16.889 ERROR 77632 --- [pool-overview-container-5,d2f4412349574202,56c98e08be46] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 2024-06-04 10:51:16.889 ERROR 77632 --- [pool-overview-container-5,d2f4412349574202,56c98e08be46] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.889 WARN 77632 --- [pool-overview-container-5,d2f4412349574202,56c98e08be46] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.889 ERROR 77632 --- [pool-overview-container-1,b5e4e4823482433a,8f19b76d4004] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.889 WARN 77632 --- [pool-overview-container-1,b5e4e4823482433a,8f19b76d4004] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1221, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:16.955 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1287, createErrorCount 87 2024-06-04 10:51:17.028 WARN 77632 --- [pool-ocp-async-3,db66a4a21aba44aa,1c976c58a62f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:17.028 INFO 77632 --- [pool-ocp-async-2,c87f637b01834c8e,355b219821e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:17.028 WARN 77632 --- [pool-ocp-async-1,97030b2b64b1472b,d783bc6ad110] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:17.028 WARN 77632 --- [pool-ocp-async-10,7212866664a24a90,78f24b11a3b8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.028 ERROR 77632 --- [pool-ocp-async-10,7212866664a24a90,78f24b11a3b8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1361, createErrorCount 87 2024-06-04 10:51:17.028 WARN 77632 --- [pool-ocp-async-4,fd5a41fde0864bee,b9851a9eba99] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.028 ERROR 77632 --- [pool-ocp-async-4,fd5a41fde0864bee,b9851a9eba99] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1361, createErrorCount 87 2024-06-04 10:51:17.029 WARN 77632 --- [pool-ocp-async-7,f0c38167cf5e4420,2841e010ff7f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.029 ERROR 77632 --- [pool-ocp-async-7,f0c38167cf5e4420,2841e010ff7f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1362, createErrorCount 87 2024-06-04 10:51:17.065 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:17.283 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.283 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1615, createErrorCount 87 2024-06-04 10:51:17.283 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:51:17.333 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.333 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1665, createErrorCount 87 2024-06-04 10:51:17.333 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:51:17.389 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-06-04 10:51:17.389 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435603667038208 2024-06-04 10:51:17.481 WARN 77632 --- [pool-ocp-schedules-9,2eb823dfe8b6443b,7d8cf28f1cdb] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.481 ERROR 77632 --- [pool-ocp-schedules-9,2eb823dfe8b6443b,7d8cf28f1cdb] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1814, createErrorCount 87 2024-06-04 10:51:17.481 ERROR 77632 --- [pool-ocp-schedules-9,2eb823dfe8b6443b,7d8cf28f1cdb] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1814, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:17.667 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:17.669 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:17.820 WARN 77632 --- [pool-ocp-schedules-2,1fca037a618c4f6b,92df05f5f148] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.820 ERROR 77632 --- [pool-ocp-schedules-2,1fca037a618c4f6b,92df05f5f148] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 2024-06-04 10:51:17.820 ERROR 77632 --- [pool-ocp-schedules-2,1fca037a618c4f6b,92df05f5f148] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:17.939 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.939 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 2024-06-04 10:51:17.939 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:17.949 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:17.958 WARN 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:17.958 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 2024-06-04 10:51:17.958 ERROR 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:17.958 INFO 77632 --- [pool-prometheus-minute-schedule-1,3d8dcb04ab3a4a8b,19f3f96c1bc3] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469473957, count=0, elapsed=4001 2024-06-04 10:51:17.958 INFO 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:18.018 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:18.019 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 88 2024-06-04 10:51:18.019 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:18.171 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:18.171 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1, createErrorCount 88 2024-06-04 10:51:18.171 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:18.237 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:18.237 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:18.319 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:18.319 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 89 2024-06-04 10:51:18.319 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:18.712 WARN 77632 --- [pool-ocp-schedules-10,e78844098fc24588,9fbdcac11121] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:18.751 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:18.751 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 13, createErrorCount 89 2024-06-04 10:51:18.751 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:51:18.776 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:18.776 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 38, createErrorCount 89 2024-06-04 10:51:18.776 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 38, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:18.917 WARN 77632 --- [pool-prometheus-exporter-check2,06c021295f284787,fdf30b6d4d5f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:18.922 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:18.955 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.028 WARN 77632 --- [pool-ocp-async-8,27f9bd6b00bb42ce,27075924da96] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.028 WARN 77632 --- [pool-ocp-async-9,ad7eb2b7425c46a3,c1e4a60308de] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.028 INFO 77632 --- [pool-ocp-async-10,a4d7654c3e774ad8,62d65e862deb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:19.028 WARN 77632 --- [pool-ocp-async-3,db66a4a21aba44aa,1c976c58a62f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:19.028 ERROR 77632 --- [pool-ocp-async-3,db66a4a21aba44aa,1c976c58a62f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 290, createErrorCount 89 2024-06-04 10:51:19.028 WARN 77632 --- [pool-ocp-async-1,97030b2b64b1472b,d783bc6ad110] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:19.028 ERROR 77632 --- [pool-ocp-async-1,97030b2b64b1472b,d783bc6ad110] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 291, createErrorCount 89 2024-06-04 10:51:19.029 WARN 77632 --- [pool-ocp-async-2,c87f637b01834c8e,355b219821e0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.038 WARN 77632 --- [pool-ocp-async-10,a4d7654c3e774ad8,62d65e862deb] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:19.065 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:19.065 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 327, createErrorCount 89 2024-06-04 10:51:19.065 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy319.findIdByServiceTypes(Unknown Source) at com.oceanbase.ocp.service.compute.HostDaoManager.serviceTypeIn(HostDaoManager.java:282) at com.oceanbase.ocp.service.compute.HostDaoManager.findByStatusAndKeywordAndServiceType(HostDaoManager.java:202) at com.oceanbase.ocp.service.compute.HostDaoManager.findAll(HostDaoManager.java:89) at com.oceanbase.ocp.service.compute.HostDaoManager$$FastClassBySpringCGLIB$$6c2f5d71.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.service.compute.HostDaoManager$$EnhancerBySpringCGLIB$$218520c4.findAll() at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findAll(HostServiceImpl.java:286) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findAll() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildBackupHostAlarmTarget(OcpHostAlarmTargetProvider.java:80) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 44 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 327, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 86 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:19.392 WARN 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.593 WARN 77632 --- [pool-ocp-schedules-6,d919a418b8cf4e5f,65cb319015c8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.943 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.947 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:19.950 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:19.950 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1212, createErrorCount 89 2024-06-04 10:51:19.950 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1212, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:19.958 WARN 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:20.713 WARN 77632 --- [pool-ocp-schedules-10,e78844098fc24588,9fbdcac11121] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:20.713 ERROR 77632 --- [pool-ocp-schedules-10,e78844098fc24588,9fbdcac11121] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1975, createErrorCount 89 2024-06-04 10:51:20.713 ERROR 77632 --- [pool-ocp-schedules-10,e78844098fc24588,9fbdcac11121] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1975, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:20.739 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:20.740 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:20.918 WARN 77632 --- [pool-prometheus-exporter-check2,06c021295f284787,fdf30b6d4d5f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,06c021295f284787,fdf30b6d4d5f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:20.918 ERROR 77632 --- [pool-prometheus-exporter-check2,06c021295f284787,fdf30b6d4d5f] c.o.ocp.monitor.OcpMonitorManager : checkInactiveExporters failed: com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at check-inactive-exporter at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.monitor.service.OcpExporterStatusCheckServiceImpl.checkInactive(OcpExporterStatusCheckServiceImpl.java:120) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$4(OcpMonitorManager.java:149) at com.oceanbase.ocp.monitor.OcpMonitorManager$RunOnceTask.run(OcpMonitorManager.java:325) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 12 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 20 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 27 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:20.922 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:20.922 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:20.922 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:20.931 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:20.940 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:20.955 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:21.019 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.028 INFO 77632 --- [pool-ocp-async-3,acc3cdfddff8452e,99eedee42248] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:21.029 WARN 77632 --- [pool-ocp-async-5,5cca969042794150,159eb33d0118] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.029 WARN 77632 --- [pool-ocp-async-8,27f9bd6b00bb42ce,27075924da96] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.029 WARN 77632 --- [pool-ocp-async-6,b9e4484feafc4b96,6a4761e6b393] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.029 ERROR 77632 --- [pool-ocp-async-8,27f9bd6b00bb42ce,27075924da96] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:21.029 WARN 77632 --- [pool-ocp-async-9,ad7eb2b7425c46a3,c1e4a60308de] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.029 ERROR 77632 --- [pool-ocp-async-9,ad7eb2b7425c46a3,c1e4a60308de] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:21.030 WARN 77632 --- [pool-ocp-async-2,c87f637b01834c8e,355b219821e0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.030 ERROR 77632 --- [pool-ocp-async-2,c87f637b01834c8e,355b219821e0] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 90 2024-06-04 10:51:21.066 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.171 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.309 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.309 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.320 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.392 ERROR 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 85 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.fetchAfterId(SeriesKeyIdPersistent.java:84) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.fetchAfterId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.fetchAfterId(SeriesIdKeyService.java:101) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 85 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.393 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-06-04 10:51:21.393 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435041944875008 2024-06-04 10:51:21.593 WARN 77632 --- [pool-ocp-schedules-6,d919a418b8cf4e5f,65cb319015c8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.593 ERROR 77632 --- [pool-ocp-schedules-6,d919a418b8cf4e5f,65cb319015c8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 91 2024-06-04 10:51:21.594 ERROR 77632 --- [pool-ocp-schedules-6,d919a418b8cf4e5f,65cb319015c8] c.o.o.alarm.utils.task.AlarmTaskManager : refresh failed, exception: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy408.getFailedTasks(Unknown Source) at com.oceanbase.ocp.alarm.service.TaskRepositoryService.markNoHeartbeatToFailed(TaskRepositoryService.java:141) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$FastClassBySpringCGLIB$$78ac8e72.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.TaskRepositoryService$$EnhancerBySpringCGLIB$$55dedc67.markNoHeartbeatToFailed() at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.checkNoHeartbeat(AlarmTaskManager.java:179) at com.oceanbase.ocp.alarm.utils.task.AlarmTaskManager.refresh(AlarmTaskManager.java:52) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTaskManager(AlarmSchedules.java:124) at sun.reflect.GeneratedMethodAccessor443.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 30 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 72 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.776 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:21.943 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.943 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 133, createErrorCount 91 2024-06-04 10:51:21.943 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 133, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.947 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 137, createErrorCount 91 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 137, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.947 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:21.958 WARN 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:21.959 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 148, createErrorCount 91 2024-06-04 10:51:21.959 ERROR 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 148, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:21.959 INFO 77632 --- [pool-prometheus-minute-schedule-1,7e6e6d6e87be4c7d,5be01dfa177d] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469477958, count=0, elapsed=4001 2024-06-04 10:51:21.959 INFO 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:22.694 INFO 77632 --- [pool-ocp-async-8,9dfc33641d6b4841,aa74e22ffea3] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:51:22.700 WARN 77632 --- [pool-scanner-12541-1,9dfc33641d6b4841,dc00b71b98db] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:51:22.888 INFO 77632 --- [pool-ocp-async-1,b4c4ef5182fb4af4,8c6da61f1f91] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:51:22.909 INFO 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717470000, interval=3600 2024-06-04 10:51:22.932 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:22.932 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1122, createErrorCount 91 2024-06-04 10:51:22.932 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1122, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:22.940 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:22.940 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1130, createErrorCount 91 2024-06-04 10:51:22.940 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:22.956 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:23.019 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.019 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1209, createErrorCount 91 2024-06-04 10:51:23.019 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:23.028 INFO 77632 --- [pool-ocp-async-2,97f884dfbb5e4cfa,56269922ffc8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:23.029 WARN 77632 --- [pool-ocp-async-7,bf03582796754f14,baf70fff1558] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:23.029 WARN 77632 --- [pool-ocp-async-10,cf3ffdf67d3e4212,4f3cd083c185] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:23.029 WARN 77632 --- [pool-ocp-async-5,5cca969042794150,159eb33d0118] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.029 ERROR 77632 --- [pool-ocp-async-5,5cca969042794150,159eb33d0118] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1219, createErrorCount 91 2024-06-04 10:51:23.029 WARN 77632 --- [pool-ocp-async-6,b9e4484feafc4b96,6a4761e6b393] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.029 ERROR 77632 --- [pool-ocp-async-6,b9e4484feafc4b96,6a4761e6b393] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1219, createErrorCount 91 2024-06-04 10:51:23.030 WARN 77632 --- [pool-ocp-async-3,acc3cdfddff8452e,99eedee42248] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:23.039 WARN 77632 --- [pool-ocp-async-2,97f884dfbb5e4cfa,56269922ffc8] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:23.066 WARN 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.066 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1256, createErrorCount 91 2024-06-04 10:51:23.067 ERROR 77632 --- [pool-ocp-schedules-4,c2b3326bbc6246ae,f7568c97377f] c.o.o.a.service.AlarmTargetServiceImpl : get alarm target exception org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy366.findAllByKeywordPageable(Unknown Source) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl.listArbitrationServices(ArbitrationServiceImpl.java:292) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl$$FastClassBySpringCGLIB$$582de4a9.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.obops.internal.arbitration.ArbitrationServiceImpl$$EnhancerBySpringCGLIB$$556d8044.listArbitrationServices() at com.oceanbase.ocp.compute.host.service.OcpHostAlarmTargetProvider.buildArbitrationAlarmTarget(OcpHostAlarmTargetProvider.java:103) at com.oceanbase.ocp.alarm.service.AlarmTargetServiceImpl.refresh(AlarmTargetServiceImpl.java:86) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAlarmTargets(AlarmSchedules.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$PagedExecution.doExecute(JpaQueryExecution.java:179) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1256, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 77 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:23.171 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.171 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1361, createErrorCount 91 2024-06-04 10:51:23.171 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:23.320 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.320 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1510, createErrorCount 91 2024-06-04 10:51:23.320 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1510, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:23.395 WARN 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:23.777 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:23.777 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1967, createErrorCount 91 2024-06-04 10:51:23.777 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1967, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:23.812 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:23.812 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:23.959 WARN 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.283 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.333 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.381 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:24.381 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:24.687 WARN 77632 --- [pool-ocp-schedules-3,99aad81d8b314529,8b2e545823a1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.687 WARN 77632 --- [pool-ocp-schedules-5,d72077e261c24171,7418713e0a20] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.689 WARN 77632 --- [pool-ocp-schedules-17,10cf940143934507,7170de354971] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.690 WARN 77632 --- [pool-ocp-schedules-16,61b3b206421749ce,dd7ff16ba447] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.690 WARN 77632 --- [pool-ocp-schedules-1,4eac338388f04cf0,70b84685385a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.691 WARN 77632 --- [pool-ocp-schedules-2,acbba7739a71460a,5a8229c2c8ea] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.692 WARN 77632 --- [pool-ocp-schedules-10,79b62924fedd4cb2,d7c60bd9654f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.692 WARN 77632 --- [pool-ocp-schedules-19,b595121bf7a74656,f7c0b7fde3a4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.862 WARN 77632 --- [pool-overview-container-2,d0e0998bf32246bc,55977b314787] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.862 WARN 77632 --- [pool-overview-container-7,d51bf7612a654a48,cef249e768e5] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.862 WARN 77632 --- [pool-overview-container-8,30e25e39583d4a80,7077653750c9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.862 WARN 77632 --- [pool-overview-container-4,1b4e0efecb634d54,2be065d5db88] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.888 WARN 77632 --- [pool-overview-container-6,fa90a8746f294701,10c2e9155d09] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.888 WARN 77632 --- [pool-ocp-async-1,b4c4ef5182fb4af4,8c6da61f1f91] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.889 WARN 77632 --- [pool-overview-container-3,589d7c95df724c50,06face34386c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.909 WARN 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.951 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:24.956 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 74, createErrorCount 93 2024-06-04 10:51:25.028 WARN 77632 --- [pool-ocp-async-8,26190c76168b4eb8,83ce87871df4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:25.028 INFO 77632 --- [pool-ocp-async-6,39eb694539fa488c,3a68e9a5848d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:25.029 WARN 77632 --- [pool-ocp-async-9,f3bcd2e4e8e04513,f0dbb73b6d1f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:25.029 WARN 77632 --- [pool-ocp-async-7,bf03582796754f14,baf70fff1558] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:25.029 WARN 77632 --- [pool-ocp-async-10,cf3ffdf67d3e4212,4f3cd083c185] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:25.029 ERROR 77632 --- [pool-ocp-async-7,bf03582796754f14,baf70fff1558] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 147, createErrorCount 93 2024-06-04 10:51:25.029 ERROR 77632 --- [pool-ocp-async-10,cf3ffdf67d3e4212,4f3cd083c185] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 147, createErrorCount 93 2024-06-04 10:51:25.030 WARN 77632 --- [pool-ocp-async-3,acc3cdfddff8452e,99eedee42248] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:25.030 ERROR 77632 --- [pool-ocp-async-3,acc3cdfddff8452e,99eedee42248] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 148, createErrorCount 93 2024-06-04 10:51:25.395 ERROR 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 513, createErrorCount 87 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent.fetchAfterId(MeasurementIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$FastClassBySpringCGLIB$$278002a9.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.MeasurementIdPersistent$$EnhancerBySpringCGLIB$$1eefe4e.fetchAfterId() at com.oceanbase.ocp.monitor.service.MeasurementIdService.fetchAfterId(MeasurementIdService.java:32) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 513, createErrorCount 87 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:25.396 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-06-04 10:51:25.396 INFO 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=654435043945558016 2024-06-04 10:51:25.751 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:25.923 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:25.940 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:25.959 WARN 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:25.960 ERROR 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1077, createErrorCount 93 2024-06-04 10:51:25.960 ERROR 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1077, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:25.960 INFO 77632 --- [pool-prometheus-minute-schedule-1,15828f0ec6fd4faa,5a0da865ceca] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469481959, count=0, elapsed=4001 2024-06-04 10:51:25.960 INFO 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:26.020 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.171 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.283 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.284 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1401, createErrorCount 93 2024-06-04 10:51:26.284 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:51:26.321 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.334 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.334 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1452, createErrorCount 93 2024-06-04 10:51:26.334 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:51:26.687 WARN 77632 --- [pool-ocp-schedules-3,99aad81d8b314529,8b2e545823a1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.688 ERROR 77632 --- [pool-ocp-schedules-3,99aad81d8b314529,8b2e545823a1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1805, createErrorCount 93 2024-06-04 10:51:26.688 WARN 77632 --- [pool-ocp-schedules-5,d72077e261c24171,7418713e0a20] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.688 ERROR 77632 --- [pool-ocp-schedules-5,d72077e261c24171,7418713e0a20] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1806, createErrorCount 93 2024-06-04 10:51:26.688 ERROR 77632 --- [pool-ocp-schedules-5,d72077e261c24171,7418713e0a20] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkStandbyClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkStandbyClusterInfoSchedule(ClusterSchedules.java:78) at sun.reflect.GeneratedMethodAccessor494.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1806, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.688 ERROR 77632 --- [pool-ocp-schedules-3,99aad81d8b314529,8b2e545823a1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkClusterStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkClusterStatusSchedule(ClusterSchedules.java:64) at sun.reflect.GeneratedMethodAccessor493.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1805, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.689 WARN 77632 --- [pool-ocp-schedules-17,10cf940143934507,7170de354971] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.689 ERROR 77632 --- [pool-ocp-schedules-17,10cf940143934507,7170de354971] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1807, createErrorCount 93 2024-06-04 10:51:26.690 ERROR 77632 --- [pool-ocp-schedules-17,10cf940143934507,7170de354971] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at syncClusterInfoSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.syncClusterInfoSchedule(ClusterSchedules.java:89) at sun.reflect.GeneratedMethodAccessor495.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1807, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.690 WARN 77632 --- [pool-ocp-schedules-16,61b3b206421749ce,dd7ff16ba447] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.690 ERROR 77632 --- [pool-ocp-schedules-16,61b3b206421749ce,dd7ff16ba447] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1808, createErrorCount 93 2024-06-04 10:51:26.690 WARN 77632 --- [pool-ocp-schedules-1,4eac338388f04cf0,70b84685385a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.690 ERROR 77632 --- [pool-ocp-schedules-1,4eac338388f04cf0,70b84685385a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1808, createErrorCount 93 2024-06-04 10:51:26.690 ERROR 77632 --- [pool-ocp-schedules-16,61b3b206421749ce,dd7ff16ba447] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostStatusSchedule(ClusterSchedules.java:115) at sun.reflect.GeneratedMethodAccessor497.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1808, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.691 ERROR 77632 --- [pool-ocp-schedules-1,4eac338388f04cf0,70b84685385a] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostClockDiffSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostClockDiffSchedule(ClusterSchedules.java:148) at sun.reflect.GeneratedMethodAccessor498.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1808, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.691 WARN 77632 --- [pool-ocp-schedules-2,acbba7739a71460a,5a8229c2c8ea] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.691 ERROR 77632 --- [pool-ocp-schedules-2,acbba7739a71460a,5a8229c2c8ea] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1809, createErrorCount 93 2024-06-04 10:51:26.692 ERROR 77632 --- [pool-ocp-schedules-2,acbba7739a71460a,5a8229c2c8ea] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkHostAgentStatusSchedule at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkHostAgentStatusSchedule(ClusterSchedules.java:164) at sun.reflect.GeneratedMethodAccessor499.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1809, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.692 WARN 77632 --- [pool-ocp-schedules-10,79b62924fedd4cb2,d7c60bd9654f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.692 ERROR 77632 --- [pool-ocp-schedules-10,79b62924fedd4cb2,d7c60bd9654f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 93 2024-06-04 10:51:26.692 ERROR 77632 --- [pool-ocp-schedules-10,79b62924fedd4cb2,d7c60bd9654f] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllArbitrationService at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllArbitrationService(ClusterSchedules.java:180) at sun.reflect.GeneratedMethodAccessor500.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.692 WARN 77632 --- [pool-ocp-schedules-19,b595121bf7a74656,f7c0b7fde3a4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.692 ERROR 77632 --- [pool-ocp-schedules-19,b595121bf7a74656,f7c0b7fde3a4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 93 2024-06-04 10:51:26.692 ERROR 77632 --- [pool-ocp-schedules-19,b595121bf7a74656,f7c0b7fde3a4] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at checkAllStandbyTenant at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.rethrowAsLockException(JdbcLockRegistry.java:271) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:243) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:222) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.lockAndExec(ClusterSchedules.java:200) at com.oceanbase.ocp.service.task.scheduled.ClusterSchedules.checkAllStandbyTenant(ClusterSchedules.java:192) at sun.reflect.GeneratedMethodAccessor501.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.doLock(JdbcLockRegistry.java:263) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRegistry$JdbcLock.tryLock(JdbcLockRegistry.java:236) ... 16 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 24 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1810, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.777 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.862 WARN 77632 --- [pool-overview-container-7,d51bf7612a654a48,cef249e768e5] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-7,d51bf7612a654a48,cef249e768e5] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 2024-06-04 10:51:26.862 WARN 77632 --- [pool-overview-container-4,1b4e0efecb634d54,2be065d5db88] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.862 WARN 77632 --- [pool-overview-container-2,d0e0998bf32246bc,55977b314787] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-4,1b4e0efecb634d54,2be065d5db88] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-2,d0e0998bf32246bc,55977b314787] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-4,1b4e0efecb634d54,2be065d5db88] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-2,d0e0998bf32246bc,55977b314787] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.862 ERROR 77632 --- [pool-overview-container-7,d51bf7612a654a48,cef249e768e5] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.863 WARN 77632 --- [pool-overview-container-4,1b4e0efecb634d54,2be065d5db88] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.863 WARN 77632 --- [pool-overview-container-7,d51bf7612a654a48,cef249e768e5] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.863 WARN 77632 --- [pool-overview-container-8,30e25e39583d4a80,7077653750c9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.863 ERROR 77632 --- [pool-overview-container-8,30e25e39583d4a80,7077653750c9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 93 2024-06-04 10:51:26.863 ERROR 77632 --- [pool-overview-container-8,30e25e39583d4a80,7077653750c9] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.863 WARN 77632 --- [pool-overview-container-8,30e25e39583d4a80,7077653750c9] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 1, createElapseMillis 1981, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.866 WARN 77632 --- [pool-overview-container-2,d0e0998bf32246bc,55977b314787] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1980, createErrorCount 93 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.884 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.884 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.889 WARN 77632 --- [pool-overview-container-6,fa90a8746f294701,10c2e9155d09] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.889 ERROR 77632 --- [pool-overview-container-6,fa90a8746f294701,10c2e9155d09] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:26.889 ERROR 77632 --- [pool-overview-container-6,fa90a8746f294701,10c2e9155d09] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.890 WARN 77632 --- [pool-overview-container-6,fa90a8746f294701,10c2e9155d09] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.890 WARN 77632 --- [pool-ocp-async-1,b4c4ef5182fb4af4,8c6da61f1f91] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.890 ERROR 77632 --- [pool-ocp-async-1,b4c4ef5182fb4af4,8c6da61f1f91] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:26.890 WARN 77632 --- [pool-overview-container-3,589d7c95df724c50,06face34386c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.890 ERROR 77632 --- [pool-overview-container-3,589d7c95df724c50,06face34386c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:26.890 ERROR 77632 --- [pool-overview-container-3,589d7c95df724c50,06face34386c] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.891 WARN 77632 --- [pool-overview-container-3,589d7c95df724c50,06face34386c] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.910 WARN 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.910 ERROR 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:26.910 ERROR 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$1(OcpMonitorManager.java:135) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.910 INFO 77632 --- [pool-prometheus-hour-schedule-1,79517fe57f9e451e,6ad516cdc763] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469482909, count=0, elapsed=4001 2024-06-04 10:51:26.944 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.948 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:26.951 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:26.951 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:26.951 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:26.956 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.029 INFO 77632 --- [pool-ocp-async-10,e420d821ac2c404d,f6fdad197a33] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:27.029 WARN 77632 --- [pool-ocp-async-4,690c00204ecc4099,390b04c95e0a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.029 WARN 77632 --- [pool-ocp-async-5,cef9c35247364018,2285c07a219d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.029 WARN 77632 --- [pool-ocp-async-8,26190c76168b4eb8,83ce87871df4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:27.029 ERROR 77632 --- [pool-ocp-async-8,26190c76168b4eb8,83ce87871df4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:27.029 WARN 77632 --- [pool-ocp-async-9,f3bcd2e4e8e04513,f0dbb73b6d1f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:27.029 ERROR 77632 --- [pool-ocp-async-9,f3bcd2e4e8e04513,f0dbb73b6d1f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 94 2024-06-04 10:51:27.030 WARN 77632 --- [pool-ocp-async-6,39eb694539fa488c,3a68e9a5848d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.039 WARN 77632 --- [pool-ocp-async-10,e420d821ac2c404d,f6fdad197a33] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:27.398 WARN 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.454 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:27.454 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:27.753 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:27.753 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 95 2024-06-04 10:51:27.753 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:51:27.820 INFO 77632 --- [pool-ocp-schedules-13,2e705653c9d348b5,98292c9198f6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:51:27.923 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:27.923 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 95 2024-06-04 10:51:27.924 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:27.933 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:27.941 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:27.941 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 95 2024-06-04 10:51:27.941 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:27.960 WARN 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:28.020 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:28.020 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 65, createErrorCount 95 2024-06-04 10:51:28.020 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:28.172 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:28.172 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 217, createErrorCount 95 2024-06-04 10:51:28.172 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:28.307 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:28.321 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:28.321 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 366, createErrorCount 95 2024-06-04 10:51:28.321 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 366, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:28.738 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:28.778 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:28.778 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 823, createErrorCount 95 2024-06-04 10:51:28.778 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 823, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:28.944 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:28.944 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 990, createErrorCount 95 2024-06-04 10:51:28.945 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 990, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:28.951 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 993, createErrorCount 95 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 993, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:28.951 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:28.956 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1001, createErrorCount 95 2024-06-04 10:51:29.029 INFO 77632 --- [pool-ocp-async-1,453f21835f9a4582,e3692f724107] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:29.029 WARN 77632 --- [pool-ocp-async-7,dbb7a65c4a9445ba,554847f69435] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:29.029 WARN 77632 --- [pool-ocp-async-2,2c71acfb23b94f00,ca6849bc4326] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:29.029 WARN 77632 --- [pool-ocp-async-5,cef9c35247364018,2285c07a219d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:29.029 WARN 77632 --- [pool-ocp-async-4,690c00204ecc4099,390b04c95e0a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:29.029 ERROR 77632 --- [pool-ocp-async-5,cef9c35247364018,2285c07a219d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1074, createErrorCount 95 2024-06-04 10:51:29.029 ERROR 77632 --- [pool-ocp-async-4,690c00204ecc4099,390b04c95e0a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1074, createErrorCount 95 2024-06-04 10:51:29.030 WARN 77632 --- [pool-ocp-async-6,39eb694539fa488c,3a68e9a5848d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:29.031 ERROR 77632 --- [pool-ocp-async-6,39eb694539fa488c,3a68e9a5848d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1076, createErrorCount 95 2024-06-04 10:51:29.399 ERROR 77632 --- [pool-ocp-schedules-12,ccaff53a91f74016,54b0a59ba465] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey Sync key id failed. org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1443, createErrorCount 89 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:378) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:470) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:480) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent.fetchAfterId(RecordKeyIdPersistent.java:46) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$FastClassBySpringCGLIB$$c73c5afb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.RecordKeyIdPersistent$$EnhancerBySpringCGLIB$$556cca84.fetchAfterId() at com.oceanbase.ocp.monitor.service.RecordIdKeyService.fetchAfterId(RecordIdKeyService.java:113) at com.oceanbase.ocp.monitor.service.IdKeyService.syncKeyId(IdKeyService.java:80) at com.oceanbase.ocp.monitor.schedule.MonitorSchedules.syncSeriesKeyId(MonitorSchedules.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1443, createErrorCount 89 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 31 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:29.482 WARN 77632 --- [pool-ocp-schedules-10,79795ed241ac41e3,8e4d333e4ff7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:29.821 WARN 77632 --- [pool-ocp-schedules-13,2e705653c9d348b5,98292c9198f6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:29.933 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:29.933 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1978, createErrorCount 95 2024-06-04 10:51:29.933 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1978, createErrorCount 95 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:29.957 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:29.957 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:29.960 WARN 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:29.961 ERROR 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 96 2024-06-04 10:51:29.961 ERROR 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 96 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:29.961 INFO 77632 --- [pool-prometheus-minute-schedule-1,113100df0a8f4972,86e3c2eeba8b] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469485960, count=0, elapsed=4001 2024-06-04 10:51:29.961 INFO 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:30.307 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServerManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 96 2024-06-04 10:51:30.527 INFO 77632 --- [pool-metric-parse-6,,] c.o.o.m.s.OcpMetricCollectServiceImpl : Collect failed, exporter=http://192.168.5.252:62889/metrics/node/host, collectAt=1717469490, message=java.net.ConnectException: No route to host: /192.168.5.252:62889, rootCause=NoRouteToHostException: No route to host 2024-06-04 10:51:30.527 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:30.525 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:30.670 INFO 77632 --- [pool-clean-time-series-data15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:51:30.671 INFO 77632 --- [pool-print-time-series-interval15-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469490: {1717469220=57, 1717469235=57, 1717469250=57, 1717469265=57, 1717469280=57, 1717469295=57, 1717469310=57, 1717469325=8}, tsDataMapSize: 57032, readyDataCacheSize: 36176 2024-06-04 10:51:30.708 INFO 77632 --- [pool-clean-time-series-data60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : No deletable timestamps. 2024-06-04 10:51:30.709 INFO 77632 --- [pool-print-time-series-interval60-1,,] c.o.o.m.a.MonitorTimeSeriesDataProcessor : print tsData 1717469490: {}, tsDataMapSize: 80, readyDataCacheSize: 64 2024-06-04 10:51:30.739 WARN 77632 --- [pool-collect-self-metric-half-minute-1,,] c.o.o.s.c.m.InnerExporterServiceImpl : Failed to collect ocp self-metrics org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 91 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:818) at org.springframework.jdbc.core.JdbcTemplate.queryForList(JdbcTemplate.java:935) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent.querySeriesId(SeriesKeyIdPersistent.java:44) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$FastClassBySpringCGLIB$$64517815.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.monitor.storage.SeriesKeyIdPersistent$$EnhancerBySpringCGLIB$$1e122212.querySeriesId() at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.queryAndStoreToCache(SeriesIdKeyService.java:106) at com.oceanbase.ocp.monitor.service.IdKeyService.getId(IdKeyService.java:68) at com.oceanbase.ocp.monitor.service.SeriesIdKeyService.getSeriesId(SeriesIdKeyService.java:89) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.mapMetricLines(RollupMetricDataStore.java:105) at com.oceanbase.ocp.monitor.store.RollupMetricDataStore.store(RollupMetricDataStore.java:86) at com.oceanbase.ocp.server.common.metrics.InnerExporterServiceImpl.collect(InnerExporterServiceImpl.java:90) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 91 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 30 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:30.941 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:30.956 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.021 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.029 INFO 77632 --- [pool-ocp-async-9,e7ea99a1669e4236,ed894475e0db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:31.029 WARN 77632 --- [pool-ocp-async-3,a7ef449cc437482b,53e33ccf189e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.029 WARN 77632 --- [pool-ocp-async-8,146c2f1583c544ff,2e98c90242ec] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.029 WARN 77632 --- [pool-ocp-async-2,2c71acfb23b94f00,ca6849bc4326] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:31.029 ERROR 77632 --- [pool-ocp-async-2,2c71acfb23b94f00,ca6849bc4326] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1, createErrorCount 97 2024-06-04 10:51:31.029 WARN 77632 --- [pool-ocp-async-7,dbb7a65c4a9445ba,554847f69435] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:31.029 ERROR 77632 --- [pool-ocp-async-7,dbb7a65c4a9445ba,554847f69435] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1, createErrorCount 97 2024-06-04 10:51:31.031 WARN 77632 --- [pool-ocp-async-1,453f21835f9a4582,e3692f724107] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.039 WARN 77632 --- [pool-ocp-async-9,e7ea99a1669e4236,ed894475e0db] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:31.172 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.322 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.482 WARN 77632 --- [pool-ocp-schedules-10,79795ed241ac41e3,8e4d333e4ff7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:31.482 ERROR 77632 --- [pool-ocp-schedules-10,79795ed241ac41e3,8e4d333e4ff7] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 454, createErrorCount 97 2024-06-04 10:51:31.483 ERROR 77632 --- [pool-ocp-schedules-10,79795ed241ac41e3,8e4d333e4ff7] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy395.findAll(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService.listAll(OcpAlarmChannelService.java:383) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$FastClassBySpringCGLIB$$e4f7fa3b.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.alarm.service.OcpAlarmChannelService$$EnhancerBySpringCGLIB$$88da4562.listAll() at com.oceanbase.ocp.alarm.core.aggregate.AggregatorFactory.refresh(AggregatorFactory.java:95) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshAggregators(AlarmSchedules.java:109) at sun.reflect.GeneratedMethodAccessor408.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 454, createErrorCount 97 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 40 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:31.778 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.821 WARN 77632 --- [pool-ocp-schedules-13,2e705653c9d348b5,98292c9198f6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:31.821 ERROR 77632 --- [pool-ocp-schedules-13,2e705653c9d348b5,98292c9198f6] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 793, createErrorCount 97 2024-06-04 10:51:31.821 ERROR 77632 --- [pool-ocp-schedules-13,2e705653c9d348b5,98292c9198f6] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.refreshSecondExporters(OcpMonitorManager.java:173) at sun.reflect.GeneratedMethodAccessor409.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 793, createErrorCount 97 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 36 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:31.952 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:31.961 WARN 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:32.694 INFO 77632 --- [pool-ocp-async-2,c82fc492a9c64984,50360d9d3359] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:51:32.703 WARN 77632 --- [pool-scanner-12559-1,c82fc492a9c64984,9837a664116d] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:51:32.714 WARN 77632 --- [pool-ocp-schedules-4,7989b5833329438a,c800528a37d1] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:32.888 INFO 77632 --- [pool-ocp-async-4,31e282b3baba4a2a,ca5b691700ce] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:51:32.924 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:32.941 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:32.941 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1913, createErrorCount 97 2024-06-04 10:51:32.941 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:32.957 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1929, createErrorCount 97 2024-06-04 10:51:33.021 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.022 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1993, createErrorCount 97 2024-06-04 10:51:33.022 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:33.029 WARN 77632 --- [pool-ocp-async-5,bde7234904264685,f634f9117a0a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.029 WARN 77632 --- [pool-ocp-async-3,a7ef449cc437482b,53e33ccf189e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.029 ERROR 77632 --- [pool-ocp-async-3,a7ef449cc437482b,53e33ccf189e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 2001, createErrorCount 97 2024-06-04 10:51:33.029 INFO 77632 --- [pool-ocp-async-7,58988a23dc7d4104,665968528170] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:33.029 WARN 77632 --- [pool-ocp-async-10,f98df8bcbeed48ab,651b58bfec3e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.029 WARN 77632 --- [pool-ocp-async-8,146c2f1583c544ff,2e98c90242ec] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.029 ERROR 77632 --- [pool-ocp-async-8,146c2f1583c544ff,2e98c90242ec] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 2001, createErrorCount 97 2024-06-04 10:51:33.030 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.030 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.031 WARN 77632 --- [pool-ocp-async-1,453f21835f9a4582,e3692f724107] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.031 ERROR 77632 --- [pool-ocp-async-1,453f21835f9a4582,e3692f724107] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 98 2024-06-04 10:51:33.172 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.172 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 98 2024-06-04 10:51:33.172 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:33.284 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.322 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.323 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 98 2024-06-04 10:51:33.323 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 98 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.334 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.602 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.598 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.778 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.779 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 99 2024-06-04 10:51:33.779 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.946 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.951 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:33.952 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.952 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 99 2024-06-04 10:51:33.953 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.963 WARN 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:33.963 ERROR 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 99 2024-06-04 10:51:33.964 ERROR 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:33.964 INFO 77632 --- [pool-prometheus-minute-schedule-1,33cee41cc84b4fba,20607296779f] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469489961, count=0, elapsed=4003 2024-06-04 10:51:33.964 INFO 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-26,c82fc492a9c64984,9d5280630888] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-19,c82fc492a9c64984,2a8c668729ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-15,c82fc492a9c64984,44691abf739b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-8,c82fc492a9c64984,f0f9427a10e0] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-7,c82fc492a9c64984,2d36b07d57ff] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-20,c82fc492a9c64984,7bfff757ef46] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-9,c82fc492a9c64984,14966d3a75f7] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.696 WARN 77632 --- [alarm-detect-23,c82fc492a9c64984,13a2b0b931ea] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-27,c82fc492a9c64984,57785706349c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-22,c82fc492a9c64984,81de5e92167d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-28,c82fc492a9c64984,cc20b01bc4b6] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-3,c82fc492a9c64984,ae9f10745e52] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-21,c82fc492a9c64984,ef21228de57d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-13,c82fc492a9c64984,79b2884f34ab] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-1,c82fc492a9c64984,40d6f581438b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.697 WARN 77632 --- [alarm-detect-24,c82fc492a9c64984,4339e3d3e912] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.698 WARN 77632 --- [alarm-detect-17,c82fc492a9c64984,783d533ec1a4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.698 WARN 77632 --- [alarm-detect-16,c82fc492a9c64984,0599fa2bd3c9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.698 WARN 77632 --- [alarm-detect-4,c82fc492a9c64984,edbf06bf4d58] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.698 WARN 77632 --- [alarm-detect-25,c82fc492a9c64984,1eae5cc2b47f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.714 WARN 77632 --- [pool-ocp-schedules-4,7989b5833329438a,c800528a37d1] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:34.714 ERROR 77632 --- [pool-ocp-schedules-4,7989b5833329438a,c800528a37d1] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 612, createErrorCount 99 2024-06-04 10:51:34.715 ERROR 77632 --- [pool-ocp-schedules-4,7989b5833329438a,c800528a37d1] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy414.findAllAfterTime(Unknown Source) at com.oceanbase.ocp.alarm.service.OcpAlarmFilterService.listAllActive(OcpAlarmFilterService.java:177) at com.oceanbase.ocp.alarm.core.silence.GlobalSilencer.refresh(GlobalSilencer.java:65) at com.oceanbase.ocp.alarm.schedule.AlarmSchedules.refreshGlobalSilencer(AlarmSchedules.java:84) at sun.reflect.GeneratedMethodAccessor411.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 23 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 612, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 65 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:34.753 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.862 WARN 77632 --- [pool-overview-container-5,b1f28a50bf9c4069,8484153540f4] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.865 WARN 77632 --- [pool-overview-container-1,ead59f7fa05c4efe,7dfe4e8a599b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.865 WARN 77632 --- [pool-overview-container-4,a83743675b274fb1,ce4c1aabf9c8] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.865 WARN 77632 --- [pool-overview-container-7,76383f2026b84a78,2b92c7496b62] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.889 WARN 77632 --- [pool-overview-container-8,d649f839a5ab4c16,06ff8a47e6df] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.890 WARN 77632 --- [pool-ocp-async-4,31e282b3baba4a2a,ca5b691700ce] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.890 WARN 77632 --- [pool-overview-container-2,6494a7370d824e9f,dce3f77f65ca] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.925 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:34.925 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 822, createErrorCount 99 2024-06-04 10:51:34.925 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 822, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:34.934 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:34.958 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:35.029 INFO 77632 --- [pool-ocp-async-6,e333ce8bc5c14314,2eacafb67f54] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:35.029 WARN 77632 --- [pool-ocp-async-9,f7adccf78e214127,a823ad4369d9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:35.029 WARN 77632 --- [pool-ocp-async-5,bde7234904264685,f634f9117a0a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.029 ERROR 77632 --- [pool-ocp-async-5,bde7234904264685,f634f9117a0a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 927, createErrorCount 99 2024-06-04 10:51:35.029 WARN 77632 --- [pool-ocp-async-10,f98df8bcbeed48ab,651b58bfec3e] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.029 WARN 77632 --- [pool-ocp-async-3,209a9e18d50b4d61,1919bc72ed6b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:35.029 ERROR 77632 --- [pool-ocp-async-10,f98df8bcbeed48ab,651b58bfec3e] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 927, createErrorCount 99 2024-06-04 10:51:35.031 WARN 77632 --- [pool-ocp-async-7,58988a23dc7d4104,665968528170] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:35.039 WARN 77632 --- [pool-ocp-async-6,e333ce8bc5c14314,2eacafb67f54] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:35.284 WARN 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.284 ERROR 77632 --- [pool-sharding-metric-collect1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1182, createErrorCount 99 2024-06-04 10:51:35.284 INFO 77632 --- [pool-sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-metric-collect 2024-06-04 10:51:35.334 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.334 ERROR 77632 --- [pool-sharding-alarm-detect-by-target1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1232, createErrorCount 99 2024-06-04 10:51:35.334 INFO 77632 --- [pool-sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-target 2024-06-04 10:51:35.709 WARN 77632 --- [pool-ocp-async-2,c82fc492a9c64984,50360d9d3359] c.o.ocp.alarm.core.task.AlarmDetectTask : Specified waiting time elapses before detect return. 2024-06-04 10:51:35.709 WARN 77632 --- [alarm-detect-26,c82fc492a9c64984,9d5280630888] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.709 ERROR 77632 --- [alarm-detect-26,c82fc492a9c64984,9d5280630888] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.709 WARN 77632 --- [alarm-detect-8,c82fc492a9c64984,f0f9427a10e0] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.709 ERROR 77632 --- [alarm-detect-8,c82fc492a9c64984,f0f9427a10e0] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.710 ERROR 77632 --- [alarm-detect-8,c82fc492a9c64984,f0f9427a10e0] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_exists_expired_xa_trans org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.710 ERROR 77632 --- [alarm-detect-26,c82fc492a9c64984,9d5280630888] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_observer_fd_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.710 WARN 77632 --- [alarm-detect-15,c82fc492a9c64984,44691abf739b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.710 ERROR 77632 --- [alarm-detect-15,c82fc492a9c64984,44691abf739b] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.711 ERROR 77632 --- [alarm-detect-15,c82fc492a9c64984,44691abf739b] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_mem_hold_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.711 WARN 77632 --- [alarm-detect-7,c82fc492a9c64984,2d36b07d57ff] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.711 ERROR 77632 --- [alarm-detect-7,c82fc492a9c64984,2d36b07d57ff] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.712 ERROR 77632 --- [alarm-detect-7,c82fc492a9c64984,2d36b07d57ff] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_no_compaction org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.712 WARN 77632 --- [alarm-detect-20,c82fc492a9c64984,7bfff757ef46] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.712 ERROR 77632 --- [alarm-detect-20,c82fc492a9c64984,7bfff757ef46] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.712 ERROR 77632 --- [alarm-detect-20,c82fc492a9c64984,7bfff757ef46] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=agentd_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.712 WARN 77632 --- [alarm-detect-9,c82fc492a9c64984,14966d3a75f7] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-9,c82fc492a9c64984,14966d3a75f7] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.713 WARN 77632 --- [alarm-detect-22,c82fc492a9c64984,81de5e92167d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-22,c82fc492a9c64984,81de5e92167d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-9,c82fc492a9c64984,14966d3a75f7] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_no_merge org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-22,c82fc492a9c64984,81de5e92167d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_traffic_overload org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.713 WARN 77632 --- [alarm-detect-23,c82fc492a9c64984,13a2b0b931ea] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-23,c82fc492a9c64984,13a2b0b931ea] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.713 WARN 77632 --- [alarm-detect-25,c82fc492a9c64984,1eae5cc2b47f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-25,c82fc492a9c64984,1eae5cc2b47f] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.713 ERROR 77632 --- [alarm-detect-23,c82fc492a9c64984,13a2b0b931ea] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_connection_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.714 WARN 77632 --- [alarm-detect-28,c82fc492a9c64984,cc20b01bc4b6] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.714 WARN 77632 --- [alarm-detect-27,c82fc492a9c64984,57785706349c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-28,c82fc492a9c64984,cc20b01bc4b6] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-27,c82fc492a9c64984,57785706349c] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-25,c82fc492a9c64984,1eae5cc2b47f] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_cluster_status_check_failed org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-28,c82fc492a9c64984,cc20b01bc4b6] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=observer_process_stop org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.714 WARN 77632 --- [alarm-detect-3,c82fc492a9c64984,ae9f10745e52] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-3,c82fc492a9c64984,ae9f10745e52] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.714 ERROR 77632 --- [alarm-detect-27,c82fc492a9c64984,57785706349c] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_host_mem_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.715 ERROR 77632 --- [alarm-detect-3,c82fc492a9c64984,ae9f10745e52] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_stopped org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.715 WARN 77632 --- [alarm-detect-21,c82fc492a9c64984,ef21228de57d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.715 ERROR 77632 --- [alarm-detect-21,c82fc492a9c64984,ef21228de57d] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.715 ERROR 77632 --- [alarm-detect-21,c82fc492a9c64984,ef21228de57d] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=host_ntp_offset_too_large org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.716 WARN 77632 --- [alarm-detect-13,c82fc492a9c64984,79b2884f34ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.716 ERROR 77632 --- [alarm-detect-13,c82fc492a9c64984,79b2884f34ab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.716 ERROR 77632 --- [alarm-detect-13,c82fc492a9c64984,79b2884f34ab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=node_file_inode_usage org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.716 WARN 77632 --- [alarm-detect-1,c82fc492a9c64984,40d6f581438b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.716 ERROR 77632 --- [alarm-detect-1,c82fc492a9c64984,40d6f581438b] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.717 ERROR 77632 --- [alarm-detect-1,c82fc492a9c64984,40d6f581438b] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=standby_tenant_sync_delay_too_long org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.717 WARN 77632 --- [alarm-detect-24,c82fc492a9c64984,4339e3d3e912] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.717 ERROR 77632 --- [alarm-detect-24,c82fc492a9c64984,4339e3d3e912] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.717 ERROR 77632 --- [alarm-detect-24,c82fc492a9c64984,4339e3d3e912] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_expired_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.718 WARN 77632 --- [alarm-detect-17,c82fc492a9c64984,783d533ec1a4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.718 ERROR 77632 --- [alarm-detect-17,c82fc492a9c64984,783d533ec1a4] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.718 ERROR 77632 --- [alarm-detect-17,c82fc492a9c64984,783d533ec1a4] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant_large_trans_exist org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.718 WARN 77632 --- [alarm-detect-16,c82fc492a9c64984,0599fa2bd3c9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.718 ERROR 77632 --- [alarm-detect-16,c82fc492a9c64984,0599fa2bd3c9] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.719 ERROR 77632 --- [alarm-detect-16,c82fc492a9c64984,0599fa2bd3c9] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_tenant500_storage_short_meta_mem_hold_high org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.719 WARN 77632 --- [alarm-detect-4,c82fc492a9c64984,edbf06bf4d58] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.719 ERROR 77632 --- [alarm-detect-4,c82fc492a9c64984,edbf06bf4d58] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.719 WARN 77632 --- [alarm-detect-19,c82fc492a9c64984,2a8c668729ab] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.719 ERROR 77632 --- [alarm-detect-19,c82fc492a9c64984,2a8c668729ab] o.h.engine.jdbc.spi.SqlExceptionHelper : null 2024-06-04 10:51:35.719 ERROR 77632 --- [alarm-detect-4,c82fc492a9c64984,edbf06bf4d58] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=os_tsar_cpu_util_full org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.719 ERROR 77632 --- [alarm-detect-19,c82fc492a9c64984,2a8c668729ab] c.o.o.a.core.task.AlarmDetectMetricTask : detect failed, alarmType=ob_server_sstable_percent_over_threshold org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.resolvedAlarm(AlarmDetectMetricTask.java:100) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.lambda$call$0(AlarmDetectMetricTask.java:67) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:50) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:119) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:53) at com.oceanbase.ocp.alarm.core.task.AlarmDetectMetricTask.call(AlarmDetectMetricTask.java:30) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: java.sql.SQLException: null at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1707) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.lang.InterruptedException: null at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) at com.alibaba.druid.pool.DruidDataSource.pollLast(DruidDataSource.java:2269) at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1688) ... 81 common frames omitted 2024-06-04 10:51:35.942 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:35.946 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:35.946 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1843, createErrorCount 99 2024-06-04 10:51:35.946 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1843, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:35.951 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 99 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1849, createErrorCount 99 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:35.951 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:35.964 WARN 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:36.022 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:36.104 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.104 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.173 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:36.323 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:36.670 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.670 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.754 WARN 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.754 ERROR 77632 --- [pool-sharding-alarm-detect-by-rule1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.754 INFO 77632 --- [pool-sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Get lock failed, errMsg=Failed to lock mutex at shading-lock-alarm-detect-by-rule 2024-06-04 10:51:36.779 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:36.862 WARN 77632 --- [pool-overview-container-5,b1f28a50bf9c4069,8484153540f4] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.862 ERROR 77632 --- [pool-overview-container-5,b1f28a50bf9c4069,8484153540f4] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.863 ERROR 77632 --- [pool-overview-container-5,b1f28a50bf9c4069,8484153540f4] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewHosts error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.863 WARN 77632 --- [pool-overview-container-5,b1f28a50bf9c4069,8484153540f4] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:131) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewHosts(OverviewStatusContainer.java:99) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy358.findAll(Unknown Source) at com.oceanbase.ocp.compute.host.service.HostServiceImpl.findOverviewHosts(HostServiceImpl.java:324) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$FastClassBySpringCGLIB$$74b96bc3.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at com.oceanbase.ocp.compute.host.service.HostServiceImpl$$EnhancerBySpringCGLIB$$5cc855d2.findOverviewHosts() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewHosts(OverviewFacade.java:128) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 39 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 43 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.865 WARN 77632 --- [pool-overview-container-1,ead59f7fa05c4efe,7dfe4e8a599b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.865 ERROR 77632 --- [pool-overview-container-1,ead59f7fa05c4efe,7dfe4e8a599b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.865 WARN 77632 --- [pool-overview-container-7,76383f2026b84a78,2b92c7496b62] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.865 ERROR 77632 --- [pool-overview-container-7,76383f2026b84a78,2b92c7496b62] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.865 ERROR 77632 --- [pool-overview-container-7,76383f2026b84a78,2b92c7496b62] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTenants error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.866 WARN 77632 --- [pool-overview-container-7,76383f2026b84a78,2b92c7496b62] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTenants(OverviewStatusContainer.java:93) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy350.findAll(Unknown Source) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.listAllTenant(TenantDaoManagerImpl.java:388) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$df19820.listAllTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenant(TenantServiceImpl.java:232) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl.listAllTenantWithAuth(TenantServiceImpl.java:243) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$FastClassBySpringCGLIB$$5eecfccb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.tenant.TenantServiceImpl$$EnhancerBySpringCGLIB$$96676712.listAllTenantWithAuth() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTenants(OverviewFacade.java:114) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 43 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 47 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.866 ERROR 77632 --- [pool-overview-container-1,ead59f7fa05c4efe,7dfe4e8a599b] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewAlarms error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.866 WARN 77632 --- [pool-overview-container-1,ead59f7fa05c4efe,7dfe4e8a599b] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:160) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewAlarms(OverviewStatusContainer.java:117) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy349.findAllIds(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allClusterIds(ClusterDaoManagerImpl.java:107) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allClusterIds() at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.getAuthorizedClusterIds(ObAuthorizedFacadeImpl.java:111) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterIds(ObAuthorizedFacadeImpl.java:73) at com.oceanbase.ocp.service.ob.ObAuthorizedFacadeImpl.readableClusterNames(ObAuthorizedFacadeImpl.java:78) at com.oceanbase.ocp.alarm.service.OcpAlarmSearchService.searchActivedAlarms(OcpAlarmSearchService.java:179) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewAlarms(OverviewFacade.java:156) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 32 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 74 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.867 WARN 77632 --- [pool-overview-container-4,a83743675b274fb1,ce4c1aabf9c8] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.867 ERROR 77632 --- [pool-overview-container-4,a83743675b274fb1,ce4c1aabf9c8] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.867 ERROR 77632 --- [pool-overview-container-4,a83743675b274fb1,ce4c1aabf9c8] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewObProxys error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.867 WARN 77632 --- [pool-overview-container-4,a83743675b274fb1,ce4c1aabf9c8] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:145) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewObProxies(OverviewStatusContainer.java:105) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy359.findAll(Unknown Source) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl.listOverviewObproxy(ObproxyServiceImpl.java:775) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$FastClassBySpringCGLIB$$690f7ab2.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obproxyops.internal.ObproxyServiceImpl$$EnhancerBySpringCGLIB$$bd1d4927.listOverviewObproxy() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewObProxies(OverviewFacade.java:142) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 35 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 39 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.889 WARN 77632 --- [pool-overview-container-8,d649f839a5ab4c16,06ff8a47e6df] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.889 ERROR 77632 --- [pool-overview-container-8,d649f839a5ab4c16,06ff8a47e6df] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.890 ERROR 77632 --- [pool-overview-container-8,d649f839a5ab4c16,06ff8a47e6df] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewClusters error. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.890 WARN 77632 --- [pool-overview-container-8,d649f839a5ab4c16,06ff8a47e6df] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(), params=[] java.lang.RuntimeException: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:103) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewClusters(OverviewStatusContainer.java:87) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy377.findAllOverview(Unknown Source) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl.allServerOverviews(ClusterDaoManagerImpl.java:471) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$FastClassBySpringCGLIB$$1f10cbd.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterDaoManagerImpl$$EnhancerBySpringCGLIB$$27fc1e28.allServerOverviews() at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listLocalClusters(ClusterServiceImpl.java:458) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl.listOverviewClusters(ClusterServiceImpl.java:350) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$FastClassBySpringCGLIB$$d321c173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at com.oceanbase.ocp.obops.internal.cluster.ClusterServiceImpl$$EnhancerBySpringCGLIB$$2631de0a.listOverviewClusters() at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewClusters(OverviewFacade.java:100) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.Query.getResultList(Query.java:165) at sun.reflect.GeneratedMethodAccessor181.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy367.getResultList(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$CollectionExecution.doExecute(JpaQueryExecution.java:128) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 36 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 78 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.892 WARN 77632 --- [pool-overview-container-2,6494a7370d824e9f,dce3f77f65ca] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.892 ERROR 77632 --- [pool-overview-container-2,6494a7370d824e9f,dce3f77f65ca] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.892 ERROR 77632 --- [pool-overview-container-2,6494a7370d824e9f,dce3f77f65ca] c.o.o.s.overview.service.OverviewFacade : OverviewFacade getOverviewTasks error. org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.892 WARN 77632 --- [pool-overview-container-2,6494a7370d824e9f,dce3f77f65ca] c.o.o.s.common.config.SpringAsyncConfig : Uncaught exception, method=public void com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(), params=[] java.lang.RuntimeException: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:191) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer.syncOverviewTasks(OverviewStatusContainer.java:111) at com.oceanbase.ocp.statistics.overview.service.schdule.OverviewStatusContainer$$FastClassBySpringCGLIB$$e5934569.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.springframework.security.concurrent.DelegatingSecurityContextRunnable.run(DelegatingSecurityContextRunnable.java:82) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy347.findAll(Unknown Source) at com.oceanbase.ocp.service.task.TaskService.listOverviewTasks(TaskService.java:224) at com.oceanbase.ocp.statistics.overview.service.OverviewFacade.getOverviewTasks(OverviewFacade.java:188) ... 13 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 29 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2001, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 33 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.893 WARN 77632 --- [pool-ocp-async-4,31e282b3baba4a2a,ca5b691700ce] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.893 ERROR 77632 --- [pool-ocp-async-4,31e282b3baba4a2a,ca5b691700ce] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2002, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.934 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:36.934 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:36.935 INFO 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:36.958 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:37.029 WARN 77632 --- [pool-ocp-async-1,be050e8952bd4b0e,f4039676601d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:37.029 INFO 77632 --- [pool-ocp-async-6,73f4e17f171e4f93,3996a5157ad9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:37.030 WARN 77632 --- [pool-ocp-async-9,f7adccf78e214127,a823ad4369d9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:37.030 ERROR 77632 --- [pool-ocp-async-9,f7adccf78e214127,a823ad4369d9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:37.030 WARN 77632 --- [pool-ocp-async-8,94ef74091bce4e98,b28436db3194] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:37.030 WARN 77632 --- [pool-ocp-async-3,209a9e18d50b4d61,1919bc72ed6b] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:37.030 ERROR 77632 --- [pool-ocp-async-3,209a9e18d50b4d61,1919bc72ed6b] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:37.031 WARN 77632 --- [pool-ocp-async-7,58988a23dc7d4104,665968528170] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:37.031 ERROR 77632 --- [pool-ocp-async-7,58988a23dc7d4104,665968528170] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 101 2024-06-04 10:51:37.942 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:37.942 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 771, createErrorCount 101 2024-06-04 10:51:37.942 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:37.964 WARN 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:37.964 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 793, createErrorCount 101 2024-06-04 10:51:37.965 ERROR 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 793, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:37.965 INFO 77632 --- [pool-prometheus-minute-schedule-1,4ac594bcd51d4ce1,d8f43fb35a49] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469493964, count=0, elapsed=4001 2024-06-04 10:51:37.965 INFO 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:38.022 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:38.022 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 851, createErrorCount 101 2024-06-04 10:51:38.022 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:38.173 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:38.173 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1002, createErrorCount 101 2024-06-04 10:51:38.173 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:38.323 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:38.324 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1153, createErrorCount 101 2024-06-04 10:51:38.324 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1153, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:38.779 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:38.779 ERROR 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1609, createErrorCount 101 2024-06-04 10:51:38.780 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at ready_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$0(TaskCoordinator.java:67) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1609, createErrorCount 101 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:38.953 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:38.958 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:39.029 INFO 77632 --- [pool-ocp-async-4,2754ccf52fa64cd5,3e552936a90b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:39.030 WARN 77632 --- [pool-ocp-async-1,be050e8952bd4b0e,f4039676601d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:39.030 ERROR 77632 --- [pool-ocp-async-1,be050e8952bd4b0e,f4039676601d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1859, createErrorCount 101 2024-06-04 10:51:39.030 WARN 77632 --- [pool-ocp-async-5,d79b3351a96549af,1f268e433e2f] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:39.030 WARN 77632 --- [pool-ocp-async-2,f3e99869483b4122,f54f72584f3c] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:39.030 WARN 77632 --- [pool-ocp-async-8,94ef74091bce4e98,b28436db3194] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:39.030 ERROR 77632 --- [pool-ocp-async-8,94ef74091bce4e98,b28436db3194] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1860, createErrorCount 101 2024-06-04 10:51:39.031 WARN 77632 --- [pool-ocp-async-6,73f4e17f171e4f93,3996a5157ad9] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:39.040 WARN 77632 --- [pool-ocp-async-4,2754ccf52fa64cd5,3e552936a90b] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:39.173 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:39.173 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:39.742 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:39.742 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:39.926 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:39.965 WARN 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:40.942 WARN 77632 --- [pool-subtask-coordinator1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:40.947 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:40.952 WARN 77632 --- [pool-7-thread-1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:40.953 WARN 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:40.953 ERROR 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 710, createErrorCount 103 2024-06-04 10:51:40.954 INFO 77632 --- [pool-heartbeat-alarm-detect-by-target-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 710, createErrorCount 103 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:40.958 WARN 77632 --- [ocp-updater-0,,] c.o.o.c.d.s.DistributedServiceManager : Unexpected exception Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 715, createErrorCount 103 2024-06-04 10:51:41.023 WARN 77632 --- [pool-subtask-coordinator3,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.030 INFO 77632 --- [pool-ocp-async-3,79a544ffb9384187,6fad1388381a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:41.030 WARN 77632 --- [pool-ocp-async-9,590661a08e4d449b,224ca172577d] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.030 WARN 77632 --- [pool-ocp-async-10,e7a685a2d0f545e0,9ef4409fc169] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.030 WARN 77632 --- [pool-ocp-async-5,d79b3351a96549af,1f268e433e2f] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:41.030 ERROR 77632 --- [pool-ocp-async-5,d79b3351a96549af,1f268e433e2f] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 787, createErrorCount 103 2024-06-04 10:51:41.030 WARN 77632 --- [pool-ocp-async-2,f3e99869483b4122,f54f72584f3c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:41.031 ERROR 77632 --- [pool-ocp-async-2,f3e99869483b4122,f54f72584f3c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 788, createErrorCount 103 2024-06-04 10:51:41.032 WARN 77632 --- [pool-ocp-async-6,73f4e17f171e4f93,3996a5157ad9] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:41.032 ERROR 77632 --- [pool-ocp-async-6,73f4e17f171e4f93,3996a5157ad9] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 789, createErrorCount 103 2024-06-04 10:51:41.173 WARN 77632 --- [pool-subtask-coordinator2,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.324 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.780 WARN 77632 --- [pool-task-coordinator2,29707cefc4cf49ec,f3e79fb26bed] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.822 INFO 77632 --- [pool-ocp-schedules-12,e596c98fc9da4867,9b918f3cc357] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-06-04 10:51:41.909 INFO 77632 --- [pool-prometheus-cache-monitor1,1cee631274304f88,ba8faf6de98a] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1744,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":4854,"secondWriteQueue":0,"minuteWriteCacheSize":955} 2024-06-04 10:51:41.910 INFO 77632 --- [pool-prometheus-cache-monitor1,1cee631274304f88,ba8faf6de98a] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{ob_sysstat_40012=17, node_memory_sreclaimable_bytes=12, ob_sysstat_40011=17, ob_server_resource_memory_assigned_bytes=10, ob_sysstat_40010=17, tcp_retrans=13, ob_unit_num=10, ob_database_disk_required_size=31, go_memstats_mspan_sys_bytes=10, ob_sysstat_30213=17, go_memstats_stack_sys_bytes=10, ob_sysstat_30212=17, exporter_export_metrics_bytes_total=20, ob_sysstat_30217=17, node_filesystem_size_bytes=35, ob_sysstat_30216=17, http_server_requests_seconds_count=60, ob_tenant_request_queue_total_size=20, jvm_gc_memory_allocated_bytes_total=5, ob_system_event_total_waits=21, monagent_input_sql_duration_seconds_sum=55, ob_tenant_disk_v4_log_disk_size=12, log_stream_degraded_count=16, ob_sysstat_40019=17, ob_sysstat_40018=17, processor_process_metrics_total=15, ob_plan_cache_hit_total=16, jvm_gc_max_data_size_bytes=5, node_filesystem_readonly=35, go_memstats_frees_total=10, io_await=31, host_available=7, ob_sysstat_30220=17, ob_sysstat_30222=17, ob_sysstat_30221=17, go_memstats_mallocs_total=10, ob_unit_config_max_memory_bytes=19, ob_database_disk_data_size=30, io_util=31, ob_sysstat_200002=17, ob_tenant_memstore_freeze_cnt=14, ob_sysstat_200001=17, ob_tenant_disk_v4_data_size=12, ob_tenant_unit_min_memory=26, ob_sysstat_60087=17, ob_memstore_total_bytes=20, metric_cardinality_count=12, jvm_threads_states_threads=10, process_resident_memory_bytes=10, ob_cache_size_bytes=28, ob_tenant_assigned_cpu_total=16, ob_tenant_unit_max_memory=26, input_collect_metrics_total=15, ob_sysstat_50039=17, ob_sysstat_60083=17, ob_sysstat_50038=17, node_disk_io_time_weighted_seconds_total=20, node_disk_write_time_seconds_total=20, cpu_count=13, ob_cluster_sync=6, process_open_fds=10, ob_sysstat_50037=17, process_memory_rss_bytes=17, http_status_count=13, process_max_fds=10, ob_server_resource_cpu_assigned_percent=10, ob_sysstat_50030=17, ocp_alarm_detect_duration_ms_count=122, ob_sysstat_80057=17, go_memstats_heap_inuse_bytes=10, go_memstats_mcache_sys_bytes=10, ob_sysstat_40118=17, ob_sysstat_40117=17, ob_tenant_disk_v4_log_size=12, node_memory_memfree_bytes=12, ob_sysstat_40116=17, ob_sysstat_40005=17, process_exists=26, ob_sysstat_40004=17, ob_sysstat_40003=17, ob_sysstat_40002=17, go_gc_duration_seconds=15, ob_sysstat_40001=17, ob_server_resource_disk_bytes=10, ocp_alarm_detect_duration_ms_sum=122, ob_sysstat_40000=17, jvm_threads_live_threads=5, ob_sysstat_30200=17, ob_sysstat_30201=17, ob_sysstat_30204=17, ob_sysstat_30205=17, ob_sysstat_30208=17, process_thread_count=17, ob_sysstat_30209=17, node_memory_cached_bytes=12, ob_sysstat_50040=17, ob_table_num=16, ob_sysstat_40009=17, ob_sysstat_40008=17, ob_disk_free_bytes=10, node_filesystem_avail_bytes=35, ob_sysstat_40007=17, ob_sysstat_40006=17, ob_sysstat_10000=17, ob_sysstat_10006=17, ob_sysstat_10005=17, ob_unit_config_max_iops=19, ob_plan_cache_memory_bytes=16, ob_sysstat_10002=17, node_network_transmit_errs_total=16, go_memstats_last_gc_time_seconds=10, ob_sysstat_10001=17, ob_sysstat_10004=17, ob_sysstat_10003=17, go_gc_duration_seconds_count=10, ocp_monitor_collect_request_duration_ms_count=9, monagent_oceanbase_plan_explain_size=3, ob_sysstat_50011=17, ob_sysstat_50010=17, monitor_exporter_avaliable=31, node_disk_read_bytes_total=20, clock_diff_milliseconds=6, ob_compaction_is_suspended=12, go_memstats_lookups_total=10, process_cpu_percent=17, log_tailer_count=10, ob_sysstat_60057=17, host_agent_process_status=10, ob_server_resource_cpu=10, go_memstats_alloc_bytes=10, ob_server_num=14, node_cpu_seconds_total_native=18, ob_sysstat_140002=17, ob_sysstat_140005=17, ob_sysstat_140006=17, ob_sysstat_140003=17, ob_session_all_num=16, ob_tenant_resource_min_memory=16, jvm_gc_pause_seconds_count=9, ob_memstore_freeze_times=20, ob_sysstat_50022=17, ob_sysstat_50021=17, jvm_gc_overhead_percent=5, ob_system_event_time_waited=21, ob_tenant_resource_min_cpu=16, ob_cluster_status_check=7, monagent_plugin_execute_seconds_total=24, jvm_memory_committed_bytes=12, node_net_bandwidth_bps=16, monagent_oceanbase_db_pool_idle=3, ob_tenant_server_data_index_data_size=15, go_memstats_heap_idle_bytes=10, go_memstats_gc_sys_bytes=10, ob_server_resource_memory_bytes=10, go_info=11, ob_tenant_assigned_mem_assigned=16, log_tailer_processed_file_count=10, node_load15=12, ob_tenant_memstore_minor_freeze_times=14, ob_disk_log_assigned_bytes=10, ob_tenant_server_required_size=15, jvm_memory_max_bytes=12, ob_unit_config_min_iops=19, ob_sysstat_30080=17, ob_sysstat_60031=17, process_fd_count=17, ob_sysstat_30082=17, ob_sysstat_30081=17, ob_sysstat_30084=17, ob_tenant_unit_max_cpu=26, ob_sysstat_30083=17, node_memory_buffers_bytes=12, ob_sysstat_30086=17, ob_sysstat_30085=17, ob_sysstat_50009=17, go_memstats_heap_released_bytes=10, ob_tenant_log_disk_total_bytes=16, node_network_receive_bytes_total=16, ob_sysstat_50005=17, ob_sysstat_50008=17, ob_memstore_freeze_trigger_bytes=20, ob_waitevent_wait_seconds_total=16, ob_server_stopped_duration_seconds=11, ob_sysstat_50001=17, ob_sysstat_50004=17, ob_sysstat_50000=17, go_memstats_next_gc_bytes=10, ob_session_active_num=16, node_filesystem_files_free=43, ob_memtable_max_snapshot_duration_seconds=10, node_disk_read_time_seconds_total=20, ob_sysstat_60021=17, ob_sysstat_60020=17, monagent_oceanbase_audit_unique_key_cache_size=3, ob_sysstat_60024=17, ob_compaction_frozen_version=12, ob_sysstat_60023=17, metric_count=10, ob_sysstat_60022=17, process_virtual_memory_bytes=10, observer_coredump_time_seconds=10, ob_tenant_assigned_cpu_assigned=16, ob_tenant_unit_min_cpu=26, ob_unit_config_max_cpu=19, http_request_milliseconds_summary_count=27, monagent_oceanbase_audit_timeinfo_cache_size=3, ob_sysstat_20002=17, monagent_input_sql_duration_seconds_bucket=59, ob_sysstat_20001=17, node_cpu_seconds_total=20, ob_sysstat_20000=17, http_request_milliseconds_summary=30, ob_index_error_num=6, ob_tenant_memory_hold_bytes=16, ob_sysstat_30066=17, ob_log_level_count=12, go_memstats_buck_hash_sys_bytes=10, monagent_pipeline_report_metrics_total=10, ob_tenant_disk_total_size=16, node_disk_reads_completed_total=20, exporter_export_metrics_total=20, ob_disk_log_total_bytes=10, ob_sysstat_60019=17, system_cpu_count=5, process_uptime_seconds=17, ob_sysstat_130004=17, ob_sysstat_60003=17, ob_sysstat_60002=17, ob_sysstat_60001=17, ob_sysstat_60000=17, go_memstats_heap_sys_bytes=10, ocp_meta_db_health=6, ob_sysstat_140012=17, ob_sysstat_140013=17, jvm_gc_pause_seconds_max=9, ob_disk_total_bytes=10, watch_ob_dir_exists=15, ob_tenant_request_queue_large_size=20, go_memstats_heap_objects=10, go_memstats_mcache_inuse_bytes=10, go_memstats_other_sys_bytes=10, ob_sysstat_130000=17, jvm_memory_used_bytes=12, ob_sysstat_130001=17, go_threads=10, ob_sysstat_130002=17, ob_sysstat_60005=17, ob_sysstat_60004=17, http_request_milliseconds_summary_sum=27, http_server_requests_seconds_sum=60, ob_memstore_active_bytes=20, go_memstats_alloc_bytes_total=10, ob_tenant_assigned_mem_total=16, process_count=18, node_memory_memtotal_bytes=12, node_network_transmit_drop_total=16, ob_waitevent_wait_total=16, ob_tenant_log_disk_used_bytes=16, jvm_gc_memory_promoted_bytes_total=5, ob_sysstat_30011=17, ob_sysstat_30010=17, ob_sysstat_30013=17, ob_sysstat_30012=17, ob_disk_log_used_bytes=10, ob_tenant500_memory_used_bytes=10, node_network_transmit_bytes_total=16, ob_compaction_is_error=12, node_network_receive_drop_total=16, monagent_pipeline_execute_total=16, node_filesystem_files=43, process_start_time_seconds=10, ob_tenant_log_sync_delay=16, go_memstats_heap_alloc_bytes=10, ob_tenant_resource_max_cpu=16, go_gc_duration_seconds_sum=10, go_memstats_mspan_inuse_bytes=10, ob_server_resource_memory_assigned_percent=10, monagent_pipeline_execute_seconds_total=16, jvm_gc_pause_seconds_sum=9, ob_sysstat_80001=17, go_memstats_sys_bytes=10, node_network_receive_errs_total=16, system_load_average_1m=5, monagent_oceanbase_audit_stat_cache_size=3, observer_ulimit_max_fd_count=10, ob_plan_cache_access_total=16, ob_tenant_memory_used_bytes=16, monagent_oceanbase_plan_cache_size=3, monagent_oceanbase_audit_sample_cache_size=3, ob_tenant_server_data_size=15, ob_sysstat_80002=17, ob_sysstat_80003=17, ob_sysstat_80007=17, node_disk_writes_completed_total=20, ob_sysstat_80008=17, ob_sysstat_80009=17, ob_tenant_memstore_compact_trigger_ratio=14, ob_sysstat_40030=17, process_cpu_seconds_total=10, node_load1=12, ob_sysstat_120001=17, ob_sysstat_120002=17, ob_sysstat_120000=17, ob_tenant_resource_max_memory=16, system_cpu_usage=5, ob_sysstat_120009=17, go_memstats_stack_inuse_bytes=10, ob_sysstat_120008=17, node_load5=12, ob_sysstat_120005=17, jvm_threads_peak_threads=5, ob_sysstat_120006=17, process_cpu_usage=5, monagent_input_sql_duration_seconds_count=55, node_disk_written_bytes_total=20, monagent_oceanbase_ash_cache_size=3, monagent_pipeline_process_metrics_total=20, go_goroutines=10, ob_compaction_last_version=12, ob_sysstat_30000=17, ob_sysstat_30002=17, ob_server_resource_cpu_assigned=10, ob_sysstat_30001=17, ob_unit_config_min_cpu=19, process_virtual_memory_max_bytes=10, monagent_oceanbase_plan_timeinfo_cache_size=3, monagent_plugin_execute_total=24, ob_sysstat_30006=17, ob_tenant500_memory_hold_bytes=10, ob_sysstat_30005=17, arbitration_status_inactive_server_count=6, ob_sysstat_30008=17, ob_sysstat_30007=17, ob_sysstat_30009=17, ob_compaction_current_timestamp=12, ob_clog_max_sync_delay_seconds=13, oceanbase_connectivity=12} 2024-06-04 10:51:41.926 WARN 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:41.926 ERROR 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1683, createErrorCount 103 2024-06-04 10:51:41.927 INFO 77632 --- [pool-heartbeat-metric-collect-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1683, createErrorCount 103 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:41.936 WARN 77632 --- [pool-heartbeat-alarm-detect-by-rule-192.168.5.253:80801,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:41.965 WARN 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:41.965 ERROR 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1722, createErrorCount 103 2024-06-04 10:51:41.966 ERROR 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.interceptor.TransactionAspectSupport.createTransactionIfNecessary(TransactionAspectSupport.java:595) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:382) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy443.findAll(Unknown Source) at com.oceanbase.ocp.monitor.service.OcpExporterServiceImpl.fetchAll(OcpExporterServiceImpl.java:138) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllExporters(ShardingExporterHelper.java:58) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:45) at com.oceanbase.ocp.monitor.service.ShardingExporterHelper.findAllocatedExporters(ShardingExporterHelper.java:49) at com.oceanbase.ocp.monitor.OcpMonitorManager.lambda$initScheduleTask$0(OcpMonitorManager.java:130) at com.oceanbase.ocp.monitor.OcpMonitorManager$IntervalCollectScheduleTask.run(OcpMonitorManager.java:278) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.internal.SessionImpl.connection(SessionImpl.java:516) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:152) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 28 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 1722, createErrorCount 103 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 32 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:41.966 INFO 77632 --- [pool-prometheus-minute-schedule-1,296edda78dfc4784,d680dc2bc663] c.o.ocp.monitor.OcpMonitorManager : Schedule interval metric too slow, from=1717469497965, count=0, elapsed=4001 2024-06-04 10:51:41.966 INFO 77632 --- [pool-prometheus-minute-schedule-1,26934a97d1ea4e36,b359a73b5c8b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1717469520, interval=60 2024-06-04 10:51:42.244 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.245 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. connect timed out at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.284 WARN 77632 --- [pool-sharding-metric-collect1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:42.307 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:42.335 WARN 77632 --- [pool-sharding-alarm-detect-by-target1,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:42.694 INFO 77632 --- [pool-ocp-async-4,c7f08b9352044ad4,a75e3a70e063] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-06-04 10:51:42.699 WARN 77632 --- [pool-scanner-12575-1,c7f08b9352044ad4,e6e1c4924e7a] c.o.o.m.helper.MetricSearchContainer : label is null, return all seriesIds, metricName = node_net_bandwidth_bps, seriesId size = 9 2024-06-04 10:51:42.813 ERROR 77632 --- [Druid-ConnectionPool-Create-2037087596,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.813 ERROR 77632 --- [Druid-ConnectionPool-Create-1397998595,,] com.alibaba.druid.pool.DruidDataSource : create connection SQLException, url: jdbc:oceanbase://192.168.5.252:2883/monitor_database?useUnicode=true&characterEncoding=utf-8&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull, errorCode -1, state 08000 java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.889 INFO 77632 --- [pool-ocp-async-6,f8b5998935604aeb,2fe708db6e51] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-06-04 10:51:42.943 WARN 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:42.943 ERROR 77632 --- [pool-subtask-coordinator1,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:42.943 INFO 77632 --- [pool-subtask-coordinator1,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=running_subtask_worker 2024-06-04 10:51:42.947 WARN 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:42.947 ERROR 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:42.948 INFO 77632 --- [pool-heartbeat-task-192.168.5.253:80801,,] c.o.o.c.s.registry.ConsumerRegistry : Heartbeat failed. org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241) at com.sun.proxy.$Proxy412.findByModuleAndName(Unknown Source) at com.oceanbase.ocp.core.sharding.registry.ConsumerRegistry.heartbeat(ConsumerRegistry.java:86) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.connection(StatementPreparerImpl.java:50) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$5.doPrepare(StatementPreparerImpl.java:149) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl$StatementPreparationTemplate.prepareStatement(StatementPreparerImpl.java:176) at org.hibernate.engine.jdbc.internal.StatementPreparerImpl.prepareQueryStatement(StatementPreparerImpl.java:151) at org.hibernate.loader.Loader.prepareQueryStatement(Loader.java:2122) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2059) at org.hibernate.loader.Loader.executeQueryStatement(Loader.java:2037) at org.hibernate.loader.Loader.doQuery(Loader.java:956) at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:357) at org.hibernate.loader.Loader.doList(Loader.java:2868) at org.hibernate.loader.Loader.doList(Loader.java:2850) at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2682) at org.hibernate.loader.Loader.list(Loader.java:2677) at org.hibernate.loader.hql.QueryLoader.list(QueryLoader.java:540) at org.hibernate.hql.internal.ast.QueryTranslatorImpl.list(QueryTranslatorImpl.java:400) at org.hibernate.engine.query.spi.HQLQueryPlan.performList(HQLQueryPlan.java:218) at org.hibernate.internal.SessionImpl.list(SessionImpl.java:1459) at org.hibernate.query.internal.AbstractProducedQuery.doList(AbstractProducedQuery.java:1649) at org.hibernate.query.internal.AbstractProducedQuery.list(AbstractProducedQuery.java:1617) at org.hibernate.query.internal.AbstractProducedQuery.getSingleResult(AbstractProducedQuery.java:1665) at org.hibernate.query.criteria.internal.compile.CriteriaQueryTypeQueryAdapter.getSingleResult(CriteriaQueryTypeQueryAdapter.java:111) at sun.reflect.GeneratedMethodAccessor156.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.orm.jpa.SharedEntityManagerCreator$DeferredQueryInvocationHandler.invoke(SharedEntityManagerCreator.java:410) at com.sun.proxy.$Proxy332.getSingleResult(Unknown Source) at org.springframework.data.jpa.repository.query.JpaQueryExecution$SingleEntityExecution.doExecute(JpaQueryExecution.java:198) at org.springframework.data.jpa.repository.query.JpaQueryExecution.execute(JpaQueryExecution.java:90) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.doExecute(AbstractJpaQuery.java:156) at org.springframework.data.jpa.repository.query.AbstractJpaQuery.execute(AbstractJpaQuery.java:144) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137) ... 15 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 58 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.952 WARN 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error in getting leader address org.springframework.jdbc.CannotGetJdbcConnectionException: Failed to obtain JDBC Connection; nested exception is com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:84) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:721) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:752) at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:765) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:887) at org.springframework.jdbc.core.JdbcTemplate.queryForObject(JdbcTemplate.java:914) at com.oceanbase.ocp.core.distributed.service.DefaultServiceUpdater.getLeader(DefaultServiceUpdater.java:66) at com.oceanbase.ocp.core.distributed.service.DistributedServiceManager.getLeader(DistributedServiceManager.java:93) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.refreshLeaderAddress(RateLimitFacadeServiceImpl.java:307) at com.oceanbase.ocp.service.iam.ratelimit.service.RateLimitFacadeServiceImpl$LeadershipCompetingTask.run(RateLimitFacadeServiceImpl.java:273) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.springframework.jdbc.datasource.DataSourceUtils.fetchConnection(DataSourceUtils.java:160) at org.springframework.jdbc.datasource.DataSourceUtils.doGetConnection(DataSourceUtils.java:118) at org.springframework.jdbc.datasource.DataSourceUtils.getConnection(DataSourceUtils.java:81) ... 17 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted 2024-06-04 10:51:42.952 INFO 77632 --- [pool-7-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-06-04 10:51:42.958 WARN 77632 --- [ocp-updater-0,,] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:43.023 WARN 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:43.023 ERROR 77632 --- [pool-subtask-coordinator3,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:43.023 INFO 77632 --- [pool-subtask-coordinator3,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=failed_subtask_worker 2024-06-04 10:51:43.030 INFO 77632 --- [pool-ocp-async-5,87988086da1f45f8,1c72b27da955] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-06-04 10:51:43.030 WARN 77632 --- [pool-ocp-async-7,dfb50f48861643d7,6265eb4a973b] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:43.030 WARN 77632 --- [pool-ocp-async-1,6c6f4da35dd147be,ba0345d6b56e] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:43.030 WARN 77632 --- [pool-ocp-async-10,e7a685a2d0f545e0,9ef4409fc169] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:43.030 ERROR 77632 --- [pool-ocp-async-10,e7a685a2d0f545e0,9ef4409fc169] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:43.030 WARN 77632 --- [pool-ocp-async-9,590661a08e4d449b,224ca172577d] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:43.030 ERROR 77632 --- [pool-ocp-async-9,590661a08e4d449b,224ca172577d] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:43.032 WARN 77632 --- [pool-ocp-async-3,79a544ffb9384187,6fad1388381a] com.alibaba.druid.pool.DruidDataSource : get connection timeout retry : 1 2024-06-04 10:51:43.040 WARN 77632 --- [pool-ocp-async-5,87988086da1f45f8,1c72b27da955] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-06-04 10:51:43.174 WARN 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:43.174 ERROR 77632 --- [pool-subtask-coordinator2,,] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 0, createErrorCount 105 2024-06-04 10:51:43.174 INFO 77632 --- [pool-subtask-coordinator2,,] c.o.o.c.t.e.c.SubtaskCoordinator : Worker schedule failed, name=ready_subtask_worker 2024-06-04 10:51:43.324 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null 2024-06-04 10:51:43.324 ERROR 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 11, createErrorCount 105 2024-06-04 10:51:43.325 WARN 77632 --- [pool-task-coordinator1,7aa2482b21074de8,2ccb41937d9a] c.o.o.c.t.e.coordinator.TaskCoordinator : Schedule failed. com.oceanbase.ocp.core.distributed.lock.LockException: Failed to lock mutex at running_task_worker at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.rethrowAsLockException(JdbcLockDelegateRegistry.java:213) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:272) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:244) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lockAndExecute(TaskCoordinator.java:96) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$startup$1(TaskCoordinator.java:68) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.springframework.transaction.CannotCreateTransactionException: Could not open JPA EntityManager for transaction; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:467) at org.springframework.transaction.support.AbstractPlatformTransactionManager.startTransaction(AbstractPlatformTransactionManager.java:400) at org.springframework.transaction.support.AbstractPlatformTransactionManager.getTransaction(AbstractPlatformTransactionManager.java:373) at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:137) at org.springframework.transaction.support.TransactionOperations.executeWithoutResult(TransactionOperations.java:67) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.deleteExpired(JdbcLockRepository.java:117) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockRepository.acquire(JdbcLockRepository.java:89) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.doLock(JdbcLockDelegateRegistry.java:278) at com.oceanbase.ocp.core.distributed.lock.jdbc.JdbcLockDelegateRegistry$JdbcDelegateLock.tryLock(JdbcLockDelegateRegistry.java:261) ... 10 common frames omitted Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:42) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getPhysicalConnection(LogicalConnectionManagedImpl.java:138) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.getConnectionForTransactionManagement(LogicalConnectionManagedImpl.java:276) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.begin(LogicalConnectionManagedImpl.java:284) at org.hibernate.resource.transaction.backend.jdbc.internal.JdbcResourceLocalTransactionCoordinatorImpl$TransactionDriverControlImpl.begin(JdbcResourceLocalTransactionCoordinatorImpl.java:246) at org.hibernate.engine.transaction.internal.TransactionImpl.begin(TransactionImpl.java:83) at org.springframework.orm.jpa.vendor.HibernateJpaDialect.beginTransaction(HibernateJpaDialect.java:164) at org.springframework.orm.jpa.JpaTransactionManager.doBegin(JpaTransactionManager.java:421) ... 18 common frames omitted Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 2000, active 0, maxActive 200, creating 1, createElapseMillis 11, createErrorCount 105 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1773) at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1427) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1407) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1397) at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) at org.hibernate.engine.jdbc.connections.internal.DatasourceConnectionProviderImpl.getConnection(DatasourceConnectionProviderImpl.java:122) at org.hibernate.internal.NonContextualJdbcConnectionAccess.obtainConnection(NonContextualJdbcConnectionAccess.java:38) at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:108) ... 25 common frames omitted Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to HostAddress{host='192.168.5.252', port=2883}. No route to host (Host unreachable) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:225) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1659) at com.oceanbase.jdbc.internal.util.Utils.retrieveProxy(Utils.java:1427) at com.oceanbase.jdbc.OceanBaseConnection.newConnection(OceanBaseConnection.java:306) at com.oceanbase.jdbc.Driver.connect(Driver.java:89) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1657) at com.alibaba.druid.pool.DruidAbstractDataSource.createPhysicalConnection(DruidAbstractDataSource.java:1723) at com.alibaba.druid.pool.DruidDataSource$CreateConnectionThread.run(DruidDataSource.java:2838) Caused by: java.net.NoRouteToHostException: No route to host (Host unreachable) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createSocket(AbstractConnectProtocol.java:286) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.createConnection(AbstractConnectProtocol.java:552) at com.oceanbase.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1639) ... 6 common frames omitted